-- Logs begin at Tue 2022-02-08 15:48:36 UTC, end at Tue 2022-02-08 17:04:22 UTC. -- Feb 08 16:33:01.074925 dv-cinder-827860-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 08 16:33:01.082278 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 08 16:33:01.086106 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Feb 8 16:33:01 2022] *** Feb 08 16:33:01.086106 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 08 16:33:01.086106 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 08 16:33:01.086106 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: nodename: dv-cinder-827860-2-iscsi Feb 08 16:33:01.086106 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: machine: x86_64 Feb 08 16:33:01.086106 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: clock source: unix Feb 08 16:33:01.086106 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: pcre jit disabled Feb 08 16:33:01.086106 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: detected number of CPU cores: 4 Feb 08 16:33:01.086106 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: current working directory: / Feb 08 16:33:01.086106 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: detected binary path: /usr/bin/uwsgi-core Feb 08 16:33:01.086727 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: your processes number limit is 47680 Feb 08 16:33:01.086727 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: your memory page size is 4096 bytes Feb 08 16:33:01.086727 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: detected max file descriptor number: 2048 Feb 08 16:33:01.086727 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: lock engine: pthread robust mutexes Feb 08 16:33:01.086727 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: thunder lock: enabled Feb 08 16:33:01.086727 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 08 16:33:01.086727 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 08 16:33:01.131390 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: Python main interpreter initialized at 0x55855c7539c0 Feb 08 16:33:01.131390 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: python threads support enabled Feb 08 16:33:01.131390 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: your server socket listen backlog is limited to 100 connections Feb 08 16:33:01.131390 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: your mercy for graceful operations on workers is 90 seconds Feb 08 16:33:01.132347 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: mapped 403077 bytes (393 KB) for 2 cores Feb 08 16:33:01.132347 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: *** Operational MODE: preforking *** Feb 08 16:33:01.132638 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: *** uWSGI is running in multiple interpreter mode *** Feb 08 16:33:01.132638 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: spawned uWSGI master process (pid: 108448) Feb 08 16:33:01.132858 dv-cinder-827860-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 08 16:33:01.133745 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: spawned uWSGI worker 1 (pid: 108449, cores: 1) Feb 08 16:33:01.133745 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: spawned uWSGI worker 2 (pid: 108450, cores: 1) Feb 08 16:33:01.133927 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 08 16:33:02.934110 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 16:33:02.934110 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: from cryptography.utils import int_from_bytes Feb 08 16:33:02.934799 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 16:33:02.934799 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: from cryptography.utils import int_from_bytes Feb 08 16:33:02.935931 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 16:33:02.935931 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: from cryptography.utils import int_from_bytes Feb 08 16:33:02.936407 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 16:33:02.936407 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: from cryptography.utils import int_from_bytes Feb 08 16:33:05.532325 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 08 16:33:05.532968 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 08 16:33:05.533056 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 08 16:33:05.533426 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 08 16:33:05.533686 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 08 16:33:05.534077 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.534403 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.534728 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.535046 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.535378 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.535675 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 08 16:33:05.536081 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.536178 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 08 16:33:05.536266 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.536353 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.536442 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 08 16:33:05.536658 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.536814 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 08 16:33:05.536911 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.537075 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 08 16:33:05.537223 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.537468 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.537553 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-827860-2-iscsi {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.538381 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.538474 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.538694 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.538796 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.539009 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.539147 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.539328 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.539459 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.539634 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.539805 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.539987 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.540129 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.540296 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.540442 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.540653 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.540787 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.542007 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.542145 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.542272 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.542397 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.542538 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-827860-2-iscsi {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.542672 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.542816 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.542943 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.543074 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.543207 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.543333 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.543458 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.543591 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.543719 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.543909 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.544045 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.544191 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.544317 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.544459 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.544586 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.544706 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.544843 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-827860-2-iscsi {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.545051 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.545187 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.545458 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.545601 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.545718 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.545854 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.545980 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.546105 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.546238 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.546370 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.546486 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.546620 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.546754 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.546879 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.547009 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.547134 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.547273 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.547399 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.547530 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.547664 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.547828 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-827860-2-iscsi {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.547968 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.548094 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.548218 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.548352 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.548485 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.548621 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.548765 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.549027 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.549170 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.549345 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.549476 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.549662 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.549792 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.549968 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.550112 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.550278 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.550418 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.550558 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.550686 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.550810 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.550949 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.551135 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.551264 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.551462 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.551592 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.551809 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.551963 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.552091 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.552217 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.552341 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.552490 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.552636 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.552807 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.552938 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.553135 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.553264 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.554076 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.554430 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.554645 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.554779 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.554907 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.555031 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.555155 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.555288 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.555415 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.555590 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.555721 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.555925 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.556068 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.556255 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.556392 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.556576 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.556713 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.556847 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.556985 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.557155 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.557285 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.557488 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.557625 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.557852 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.557985 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.558125 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.558250 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.558428 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.558568 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.558773 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.558904 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.559111 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.559241 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.559392 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.559522 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.559717 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.559882 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.560058 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.560202 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.560368 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.560496 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.560722 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.560859 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.560985 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.561112 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.561295 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.561433 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.561633 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.561762 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.561938 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.562066 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.562192 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.562326 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.562480 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.562610 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.562788 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.562924 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.563111 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.563251 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.563421 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.563552 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.563730 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.563895 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.564063 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.564203 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.564367 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.564497 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.564675 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.564814 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.564986 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.565126 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.565298 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.565428 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.565607 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.565751 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.565916 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.566057 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.566228 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.566359 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.566539 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.566669 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.566842 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.566978 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.567136 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.567266 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.567458 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.567596 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.567831 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.567965 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.568109 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.568237 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.568401 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.568531 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.568706 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.568835 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.569066 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.569407 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.569586 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.569768 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.569955 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.570083 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.570208 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.570332 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.570460 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.570596 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.570802 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.570930 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.571055 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.571207 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.571333 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.571457 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.571593 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.571720 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.571872 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.571998 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.572122 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.572261 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.572419 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.572544 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.572727 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.572857 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.573046 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.573188 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.573355 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.573484 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.573666 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.573829 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.573956 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.574090 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.574266 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.574402 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.574573 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.574702 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.574882 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.575023 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.575189 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.575320 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.575496 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.575625 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.575803 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.575946 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.576139 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.576277 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.576447 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.576582 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.576763 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.576902 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.577077 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.577207 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.577372 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.577499 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.577694 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.577823 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.578009 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.578146 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.578327 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.578458 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.578641 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.578771 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.578952 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.579081 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.579333 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.579475 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.579621 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.579780 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.579910 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.580036 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.580211 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.580355 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.580545 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.580676 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.580864 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.580994 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.581182 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.581345 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.581495 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.581626 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.581810 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.581938 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:33:05.582133 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.582276 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.582456 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.582587 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.582790 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.582920 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.583111 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.583251 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.583430 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.583569 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.583785 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.583919 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.584088 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.584220 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.584408 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.584538 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.584772 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.584937 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.585125 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.585267 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.585497 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.585626 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.585830 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.585959 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.586155 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.586288 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.586485 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.586615 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.586814 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.586945 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.587137 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.587273 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.587453 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.587584 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.587789 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.587923 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.588112 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.588244 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.588432 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.588560 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.588760 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.588898 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.589083 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.589211 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.589441 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.589581 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.589708 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.589847 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.590016 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.590155 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.590328 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.590460 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.590644 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.590783 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.590957 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.591087 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.591298 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.591429 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.591615 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.591773 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.591972 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.592102 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.592341 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.592484 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.592614 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.592818 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.592947 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.593072 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.593197 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.593321 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.593492 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.593638 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.593799 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.593937 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.594105 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.594236 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.594410 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.594542 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.594719 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.594841 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.595027 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.595157 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.595351 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.595491 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.595683 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.595855 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.596022 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.596152 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.596362 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.596492 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.596670 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.596799 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.596984 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.597114 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.597299 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.597437 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.597611 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.597753 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.597919 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.598059 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.598232 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.598362 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.598542 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.598671 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.598848 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.598989 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.599194 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.599333 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.599467 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.599690 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.599855 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.599996 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.600124 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.600906 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.601043 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.601211 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.601340 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.601529 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.601661 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.601843 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.601975 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.602157 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.602301 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.602471 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.602602 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.602795 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.602923 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.603107 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.603237 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.603422 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.603560 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.603732 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.603886 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.604092 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.604241 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.604410 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.604540 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.604723 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.604859 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.605052 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.605191 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.605363 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.605499 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.605668 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.605797 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.605981 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.606112 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.606290 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.606420 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.606603 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.606735 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.606911 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.607041 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.607223 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.607363 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.607528 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.607659 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.607946 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.608081 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.608215 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.608352 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.608479 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.608594 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.608731 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.608859 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.609056 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.609198 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.609368 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.609512 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.609725 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.609875 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.610011 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.610138 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.610263 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.610398 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.610604 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.610741 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.610914 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.611051 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.611259 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.611399 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.611573 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.611701 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.611911 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.612053 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.612227 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.612366 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.612540 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.612670 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.612854 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.612983 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.613163 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.613291 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.613477 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.613606 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.613790 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.613919 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.614100 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.614228 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.614418 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.614545 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.614733 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.614871 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.615057 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.615187 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.615371 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.615507 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.615698 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.615885 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.616656 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.616801 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.617021 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.617299 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.617429 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.617565 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.617692 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.617826 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.617962 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.618121 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.618300 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.618439 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.618621 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.618752 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.618949 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.619079 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.619265 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.619405 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.619581 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.619722 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.619921 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.620051 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.620222 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.620363 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.620536 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.620675 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.620910 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.621044 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.621171 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.621306 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.621476 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.621607 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.621797 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.621929 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.622108 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.622240 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.622435 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.622566 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.622747 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.622878 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.623088 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.623217 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.623343 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.623491 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.623660 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.623924 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.624068 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.624262 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.624393 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.624583 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.624713 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.624906 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.625049 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.625228 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.625367 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.625549 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.625680 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.625863 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.625993 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.626177 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.626307 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.626491 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.626621 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.626799 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.626930 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.627112 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.627251 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.627429 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.627566 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.627742 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.627896 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.628076 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.628210 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.628384 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.628515 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.628704 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.628845 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.629028 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.629166 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.629335 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.629479 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.629640 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.629771 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.629952 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.630090 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.630279 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.630420 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.630592 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.630723 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.630917 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.631048 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.631243 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.631414 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.631715 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.632043 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.632200 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.632410 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.632550 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.632729 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.632861 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.633040 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.633190 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.633352 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.633485 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.633665 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.633798 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.634015 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.634207 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.634344 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.634536 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.634668 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.634856 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.634987 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.635171 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.635301 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.635497 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.635629 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.635857 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.635999 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.636171 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.636302 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.636491 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.636623 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.636818 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.636949 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.637131 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.637250 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.637441 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.637570 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.637756 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.637887 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.638068 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.638207 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.638380 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.638508 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.638689 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.638820 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.639270 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.639412 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.639585 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.639713 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.639923 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.640054 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.640236 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.640380 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.640545 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.640676 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.640858 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.640988 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.641178 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.641323 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.641495 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.641756 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.641888 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.642093 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.642232 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.642414 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.642546 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.642741 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.642871 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.643058 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.643378 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.643517 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.643698 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.644066 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.644212 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.644387 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.644679 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.644813 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.645027 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.645297 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.645427 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.645650 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.645901 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.646033 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.646268 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.646395 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.646594 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.646732 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.646942 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.647212 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.647442 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.647575 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.648082 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.648218 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.648421 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.648683 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.648813 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.649080 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.649271 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.649427 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.649609 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.649767 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.649939 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.650093 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.650262 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.650443 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.650582 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.650766 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.650906 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.651085 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.651216 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.651402 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.651532 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.651725 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.651872 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.652070 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.652201 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.652385 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.652516 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.652700 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.652832 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.653021 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.653164 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.653335 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.653466 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.653644 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.653781 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.653955 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.654084 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.654271 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.654415 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.654594 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.654833 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.654966 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.655091 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.655217 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.655355 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.655514 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.655652 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.655871 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.656003 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.656195 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.656342 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.656509 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.656641 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.656822 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.656953 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.657129 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.657267 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.657439 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.657570 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.657752 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.657942 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.658081 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.658301 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.658432 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.658651 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.658790 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.658963 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.659101 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.659274 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.659405 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.659586 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.659717 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.659918 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.660063 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.660231 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.660361 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.660539 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.660669 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.660855 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.660987 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.661168 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.661299 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.661476 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.661606 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.661783 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.661915 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.662095 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.662216 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.662407 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.662536 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.663208 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.663493 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.663630 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.663856 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.664038 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.664296 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.664445 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.664611 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.664740 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.664925 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.665055 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.665231 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.665368 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.665545 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.665675 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.665857 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.665986 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.666163 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.666292 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.666481 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.666618 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.666799 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.666927 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.667109 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.667240 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.667416 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.667538 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.667727 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.667891 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.668068 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.668199 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.668378 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.668508 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.668690 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.668821 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.669020 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.669159 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.669338 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.669475 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.669645 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.669790 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.669955 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.670084 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.670259 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.670497 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.670625 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.670760 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.670888 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.671014 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.671139 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.671273 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.671443 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.671583 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.671748 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.671929 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.672055 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.672181 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.672364 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.672508 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.672669 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.672799 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.672996 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.673134 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.673307 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.673439 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.673613 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.673743 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.673919 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.674049 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.674223 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.674370 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.674572 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.674702 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.674828 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.674953 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.675136 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.675268 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.675450 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.675580 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.675779 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.675914 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.676096 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.676229 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.676410 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.676541 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.676744 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.676887 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.677043 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.677170 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.677349 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.677481 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.677658 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.677795 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.677970 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.678099 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.678285 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.679048 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.679183 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.679480 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.679611 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.679832 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.679978 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.680150 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.680281 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.680450 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.680580 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.680777 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.680908 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.681104 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.681245 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.681432 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.681563 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.681739 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.681897 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.682054 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.682194 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.682367 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.682497 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.682679 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.682810 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.682989 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.683128 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.683298 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.683428 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.683614 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.683743 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.683938 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.684084 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.684253 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.684393 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.684609 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.684750 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.684888 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.685016 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.685170 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.685302 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.685480 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.685611 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.685794 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.685953 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.686103 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.686241 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.686431 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.686562 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.686742 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.686881 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.687053 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.687183 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.687364 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.687494 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.687699 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.687856 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.688016 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.688153 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.688288 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.688428 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.688624 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.688757 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.688947 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.689086 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.689263 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.689401 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.689580 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.689719 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.689894 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.690031 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.690205 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.690343 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.690523 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.690652 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.690841 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.690970 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.691149 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.691292 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.691465 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.691594 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.691800 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.691964 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.692108 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.692282 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.692414 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.692598 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.692848 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.692978 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.693172 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.693305 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.693491 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.693628 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.693807 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.693999 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.694140 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.694389 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.694528 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.694746 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.694883 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.695042 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.695183 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.695350 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.695489 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.695676 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.695822 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.696124 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.696268 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.696438 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.696569 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.696747 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.696877 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.697102 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.697240 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.697418 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.697556 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.697733 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.697863 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.698056 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.698188 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.698387 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.698516 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.698698 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.698827 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.699008 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.699137 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.699320 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.699455 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.699631 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.699827 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.699987 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.700119 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.700314 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.700443 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.700629 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.700771 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.700947 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.701078 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.701253 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.701390 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.701578 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.701752 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.701905 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.702058 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.702222 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.702361 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.702549 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.702681 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.702967 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.703107 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.703293 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.703432 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.703609 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.703741 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.703960 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.704102 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.704279 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.704408 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.704585 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.704715 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.704932 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.705064 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.705191 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.705333 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.705468 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.705595 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.705769 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.705902 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.706096 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.706227 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.706402 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.706532 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.706716 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.706862 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.707033 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.707177 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.707342 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.707523 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.707663 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.707883 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.708029 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.708210 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.708354 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.708543 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.708683 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.708881 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.709013 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.709193 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.709322 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.709504 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.709918 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.709918 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.710176 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.710176 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.710415 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.710555 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.710683 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.710809 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.710942 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.711072 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.711208 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.711390 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.711523 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.711710 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.711865 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.712054 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.712199 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.712369 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.712501 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.712684 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.712815 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.713017 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.713158 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.713332 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.713469 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.713647 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.713776 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.713986 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.714128 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.714319 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.714451 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.714641 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.714773 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.714984 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.715132 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.715286 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.715416 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.715595 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.715733 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.715931 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.716065 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.716244 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.716389 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.716576 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.716711 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.716846 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.716983 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.717151 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.717394 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.717520 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.717646 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.717781 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.717908 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.718033 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.718166 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.718334 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.718467 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.718663 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.718805 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.718971 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.719130 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.719297 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.719460 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.719592 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.719809 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.719944 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.720147 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.720278 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.720453 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.720584 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.720763 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.720895 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.721084 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.721223 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.721401 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.721534 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.721715 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.721845 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.722027 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.722169 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.722347 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.722479 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.722659 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.722789 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.722972 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.723111 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.723284 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.723423 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.723612 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.723743 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.723952 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.724095 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.724272 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.724402 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.724596 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.724728 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.724910 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.725063 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.725768 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.725901 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.726091 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.726288 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.726448 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.726610 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.726767 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.726932 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.727114 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.727301 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.727441 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.727795 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.727931 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.728137 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.728268 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.728460 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.728610 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.728781 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.728937 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.729101 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.729232 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.729422 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.729563 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.729744 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.729883 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.730063 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.730195 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.730378 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.730522 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.730695 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.730827 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.731010 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.731141 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.731331 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.731465 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.731656 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.731841 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.732000 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.732139 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.732328 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.732459 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.732648 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.732898 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.733038 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.733210 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.733357 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.733539 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.733679 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.733865 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.733996 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.734190 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.734329 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.734516 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.734647 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.734830 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.734969 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.735150 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.735304 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.735502 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.735631 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.735776 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.735904 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.736094 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.736228 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.736413 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.736553 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.736731 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.736871 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.737050 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.737191 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.737364 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.737496 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.737682 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.737823 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.737998 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.738129 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.738327 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.738458 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.738648 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.738778 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.738980 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.739117 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.739297 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.739430 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.739615 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.739786 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.739967 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.740097 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.740295 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.740485 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.740629 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.740804 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.741622 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.741903 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.742033 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.742246 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.742384 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.742579 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.742707 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.742900 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.743027 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.743219 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.743347 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.743545 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.743674 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.743882 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.744041 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.744184 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.744313 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.744499 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.744635 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.744813 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.744953 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.745123 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.745254 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.745453 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.745663 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.745795 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.745932 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.746068 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.746327 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.746459 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.746659 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.746790 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.747011 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.747204 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.747343 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.747557 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.747697 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.747904 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.748054 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.748237 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.748377 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.748611 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.748740 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.748881 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.749009 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.749177 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.749308 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.749506 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.749646 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.749819 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.749959 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.750129 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.750260 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.750450 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.750588 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.750766 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.750900 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.751076 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.751207 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.751382 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.751513 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.751868 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.752014 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.752151 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.752279 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.752405 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.752626 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.752757 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.752935 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.753069 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.753265 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.753396 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.753575 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.753708 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.753882 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.754014 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.754190 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.754322 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.754505 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.754637 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.754814 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.754946 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.755119 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.755251 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.755429 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.755562 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.755810 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.755959 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.756087 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.756228 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.756358 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.756516 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.756721 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.756852 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.757120 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.757272 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.757402 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.757529 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.757655 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.757781 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.757945 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.758087 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.758250 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.758382 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.758629 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.758760 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.758943 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.759148 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.759279 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.759412 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.759561 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.759708 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.759909 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.760038 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.760201 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.760335 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.760521 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.760652 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.760834 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.760966 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.761155 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.761285 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.761471 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.761611 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.761792 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.762016 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.762147 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.762358 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.762490 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.762684 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.762824 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.763015 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.763144 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.763328 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.763468 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.763651 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.763804 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.764239 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.764501 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.764639 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.764774 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.764920 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.765049 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.765175 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.765301 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.765474 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.765619 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.765791 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.766004 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.766135 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.766275 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.766420 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.766549 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.766757 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.766888 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.767022 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.767320 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.767458 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.767636 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.767817 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.767978 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.768110 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.768294 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.768446 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.768615 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.768760 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.768959 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.769106 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.769282 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.769414 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.769595 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.769725 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.769912 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.770041 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.770232 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.770372 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.770547 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.770687 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.770861 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.771002 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.771173 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.771318 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.771483 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.771614 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.771822 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.771956 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.772195 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.772496 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.772633 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.772769 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.772899 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.773032 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.773297 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.773422 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.773616 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.773747 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.773938 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.774069 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.774267 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.774405 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.774580 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.774744 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.774922 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.775062 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.775232 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.775362 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.775525 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.775668 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.775872 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.776032 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.776231 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.776363 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.776489 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.776614 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.776795 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.776935 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.777119 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.777260 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.777460 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.777600 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.777769 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.777913 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.778078 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.778217 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.778384 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.778516 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.778696 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.778840 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.779029 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.779173 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.779365 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.779497 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.779809 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.779970 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.780089 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.780215 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.780342 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.780468 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.780650 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.780783 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.780960 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.781092 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.781288 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.781430 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.781614 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.781747 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.781931 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.782072 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.782243 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.782384 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.782575 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.782707 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.782887 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.783019 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.783200 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.783340 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.783512 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.783643 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.783845 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.783990 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.784160 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.784300 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.784472 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.784603 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.784800 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.784930 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.785129 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.785262 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.785439 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.785571 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.785766 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.785897 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.786087 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.786234 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.786429 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.786568 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.786696 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.786822 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.787013 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.787153 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.787343 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.787472 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.787654 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.788576 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.788576 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.788998 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.789128 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.789254 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.789380 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.789520 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.789649 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.789777 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.789903 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.790036 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.790162 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.790309 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.790445 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.790573 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.790731 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.790862 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.791047 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.791204 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.791384 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.791515 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.791710 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.791864 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.792062 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.792204 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.792386 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.792518 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.792705 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.792837 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.793044 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.793176 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.793366 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.793498 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.793615 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 08 16:33:05.793739 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.793995 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.794316 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.794813 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.795151 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.795493 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.795856 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.796196 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.796535 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.796888 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.797211 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.797872 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.798225 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.798596 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.798998 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.799318 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:33:05.799572 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 08 16:33:05.816947 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG oslo_db.sqlalchemy.engines [None req-bbc5f526-1db2-4614-b090-19dbdd0e652c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 16:33:05.822360 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_db.sqlalchemy.engines [None req-6e6d9d1a-a559-4dc7-a65d-060377b84e92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 16:33:05.879813 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.context [None req-bbc5f526-1db2-4614-b090-19dbdd0e652c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d3f377b9-f250-471d-9570-5d0606368cf5(cell1) {{(pid=108449) load_cells /opt/stack/nova/nova/context.py:464}} Feb 08 16:33:05.884174 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG oslo_concurrency.lockutils [None req-bbc5f526-1db2-4614-b090-19dbdd0e652c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:33:05.885729 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.context [None req-6e6d9d1a-a559-4dc7-a65d-060377b84e92 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d3f377b9-f250-471d-9570-5d0606368cf5(cell1) {{(pid=108450) load_cells /opt/stack/nova/nova/context.py:464}} Feb 08 16:33:05.885848 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG oslo_concurrency.lockutils [None req-bbc5f526-1db2-4614-b090-19dbdd0e652c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:33:05.886557 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG oslo_concurrency.lockutils [None req-bbc5f526-1db2-4614-b090-19dbdd0e652c None None] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:33:05.888521 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG oslo_concurrency.lockutils [None req-bbc5f526-1db2-4614-b090-19dbdd0e652c None None] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:33:05.890208 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_concurrency.lockutils [None req-6e6d9d1a-a559-4dc7-a65d-060377b84e92 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:33:05.891815 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_concurrency.lockutils [None req-6e6d9d1a-a559-4dc7-a65d-060377b84e92 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:33:05.892648 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_concurrency.lockutils [None req-6e6d9d1a-a559-4dc7-a65d-060377b84e92 None None] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:33:05.894674 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_concurrency.lockutils [None req-6e6d9d1a-a559-4dc7-a65d-060377b84e92 None None] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:33:05.900904 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG oslo_db.sqlalchemy.engines [None req-bbc5f526-1db2-4614-b090-19dbdd0e652c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 16:33:05.903537 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG oslo_db.sqlalchemy.engines [None req-bbc5f526-1db2-4614-b090-19dbdd0e652c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 16:33:05.909237 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_db.sqlalchemy.engines [None req-6e6d9d1a-a559-4dc7-a65d-060377b84e92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 16:33:05.912037 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_db.sqlalchemy.engines [None req-6e6d9d1a-a559-4dc7-a65d-060377b84e92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 16:33:06.062551 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG oslo_db.sqlalchemy.engines [None req-bbc5f526-1db2-4614-b090-19dbdd0e652c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 16:33:06.072455 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_db.sqlalchemy.engines [None req-6e6d9d1a-a559-4dc7-a65d-060377b84e92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 16:33:06.412481 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: WARNING keystonemiddleware.auth_token [None req-bbc5f526-1db2-4614-b090-19dbdd0e652c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 08 16:33:06.415393 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: WARNING keystonemiddleware.auth_token [None req-6e6d9d1a-a559-4dc7-a65d-060377b84e92 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 08 16:33:06.419725 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: WARNING keystonemiddleware.auth_token [None req-bbc5f526-1db2-4614-b090-19dbdd0e652c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 08 16:33:06.422211 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: WARNING keystonemiddleware.auth_token [None req-6e6d9d1a-a559-4dc7-a65d-060377b84e92 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 08 16:33:06.765080 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: WARNING keystonemiddleware.auth_token [None req-bbc5f526-1db2-4614-b090-19dbdd0e652c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 08 16:33:06.769252 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: WARNING keystonemiddleware.auth_token [None req-6e6d9d1a-a559-4dc7-a65d-060377b84e92 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 08 16:33:06.770299 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: WARNING keystonemiddleware.auth_token [None req-bbc5f526-1db2-4614-b090-19dbdd0e652c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 08 16:33:06.775171 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: WARNING keystonemiddleware.auth_token [None req-6e6d9d1a-a559-4dc7-a65d-060377b84e92 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 08 16:33:06.776012 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55855c7539c0 pid: 108449 (default app) Feb 08 16:33:06.778096 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-bbc5f526-1db2-4614-b090-19dbdd0e652c None None] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:33:06.779287 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-bbc5f526-1db2-4614-b090-19dbdd0e652c None None] 10.222.0.35 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001750 Feb 08 16:33:06.779688 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 1/1] 10.222.0.35 () {50 vars in 788 bytes} [Tue Feb 8 16:33:06 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:33:06.780448 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55855c7539c0 pid: 108450 (default app) Feb 08 16:34:32.520641 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-bbc5f526-1db2-4614-b090-19dbdd0e652c None None] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:34:32.522305 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-bbc5f526-1db2-4614-b090-19dbdd0e652c None None] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002995 Feb 08 16:34:32.534562 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 2/2] 10.222.0.35 () {54 vars in 930 bytes} [Tue Feb 8 16:34:32 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:34:32.942612 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-9410d6e0-fe80-4bd1-a6f3-175e1b556916 admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:34:32.971922 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-9410d6e0-fe80-4bd1-a6f3-175e1b556916 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.442096 Feb 08 16:34:32.974460 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 1/3] 10.222.0.35 () {60 vars in 1291 bytes} [Tue Feb 8 16:34:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:34:35.275271 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-bbc5f526-1db2-4614-b090-19dbdd0e652c None None] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:34:35.276296 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-bbc5f526-1db2-4614-b090-19dbdd0e652c None None] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Feb 08 16:34:35.276688 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 3/4] 10.222.0.35 () {54 vars in 930 bytes} [Tue Feb 8 16:34:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:34:35.341793 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-9adb7ee9-ccaa-48e7-8713-99c88a5fde35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "swap": 0}} {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:34:35.359869 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:34:35.359869 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: warnings.warn(msg) Feb 08 16:34:35.390688 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-9adb7ee9-ccaa-48e7-8713-99c88a5fde35 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107969 Feb 08 16:34:35.397769 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 2/5] 10.222.0.35 () {64 vars in 1282 bytes} [Tue Feb 8 16:34:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:34:35.610698 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-394801ca-3648-46e5-af0a-5491231a2516 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:34:35.613289 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:34:35.613289 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: warnings.warn(msg) Feb 08 16:34:35.662713 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-394801ca-3648-46e5-af0a-5491231a2516 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.263129 Feb 08 16:34:35.663476 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 4/6] 10.222.0.35 () {64 vars in 1335 bytes} [Tue Feb 8 16:34:35 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:34:37.952079 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-9adb7ee9-ccaa-48e7-8713-99c88a5fde35 admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:34:37.953036 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-9adb7ee9-ccaa-48e7-8713-99c88a5fde35 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Feb 08 16:34:37.953645 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 3/7] 10.222.0.35 () {54 vars in 930 bytes} [Tue Feb 8 16:34:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:34:38.059104 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-3f1ed4fb-7b84-4a86-889f-298076b62c93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "vcpus": 1, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:34:38.077047 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:34:38.077047 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: warnings.warn(msg) Feb 08 16:34:38.097944 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-3f1ed4fb-7b84-4a86-889f-298076b62c93 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137711 Feb 08 16:34:38.098510 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 5/8] 10.222.0.35 () {64 vars in 1282 bytes} [Tue Feb 8 16:34:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:34:38.110175 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-0c96b24f-5ed0-4d53-803b-5525364ced37 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:34:38.111624 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:34:38.111624 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: warnings.warn(msg) Feb 08 16:34:38.143625 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-0c96b24f-5ed0-4d53-803b-5525364ced37 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036980 Feb 08 16:34:38.144730 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 4/9] 10.222.0.35 () {64 vars in 1335 bytes} [Tue Feb 8 16:34:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:34:40.413208 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-3f1ed4fb-7b84-4a86-889f-298076b62c93 admin admin] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:34:40.414224 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-3f1ed4fb-7b84-4a86-889f-298076b62c93 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Feb 08 16:34:40.414948 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 6/10] 10.222.0.35 () {54 vars in 930 bytes} [Tue Feb 8 16:34:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:34:40.480036 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-ab43e328-9410-4b1d-8da9-68a0233d25e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:34:40.499123 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-ab43e328-9410-4b1d-8da9-68a0233d25e5 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077705 Feb 08 16:34:40.499904 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 5/11] 10.222.0.35 () {64 vars in 1282 bytes} [Tue Feb 8 16:34:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 08 16:34:40.511797 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-9e03bf91-99b3-4b85-a74e-4f9e20bc12b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:34:40.535679 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-9e03bf91-99b3-4b85-a74e-4f9e20bc12b3 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027328 Feb 08 16:34:40.544677 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 7/12] 10.222.0.35 () {64 vars in 1335 bytes} [Tue Feb 8 16:34:40 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:34:42.890787 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-ab43e328-9410-4b1d-8da9-68a0233d25e5 admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:34:42.891838 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-ab43e328-9410-4b1d-8da9-68a0233d25e5 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Feb 08 16:34:42.892253 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 6/13] 10.222.0.35 () {54 vars in 930 bytes} [Tue Feb 8 16:34:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:34:42.962011 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-361da930-690d-4587-b6ae-b48d13c2ed66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3", "ram": 2048, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0}} {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:34:42.987018 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-361da930-690d-4587-b6ae-b48d13c2ed66 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087841 Feb 08 16:34:42.987671 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 8/14] 10.222.0.35 () {64 vars in 1282 bytes} [Tue Feb 8 16:34:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:34:43.000525 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-746a2522-7d47-48f0-a7d5-0c5cccb7b60b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:34:43.030952 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-746a2522-7d47-48f0-a7d5-0c5cccb7b60b admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035154 Feb 08 16:34:43.031672 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 7/15] 10.222.0.35 () {64 vars in 1335 bytes} [Tue Feb 8 16:34:42 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:34:45.493009 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-361da930-690d-4587-b6ae-b48d13c2ed66 admin admin] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:34:45.494154 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-361da930-690d-4587-b6ae-b48d13c2ed66 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Feb 08 16:34:45.494558 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 9/16] 10.222.0.35 () {54 vars in 930 bytes} [Tue Feb 8 16:34:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:34:45.554558 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-37049723-7811-4a3d-9471-008daaf7b2dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "swap": 0, "name": "ds4G", "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:34:45.574128 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-37049723-7811-4a3d-9471-008daaf7b2dd admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073186 Feb 08 16:34:45.574763 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 8/17] 10.222.0.35 () {64 vars in 1282 bytes} [Tue Feb 8 16:34:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:34:45.587505 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-0dfa0447-3244-4d7e-a3ac-53753e7b31c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:34:45.612833 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-0dfa0447-3244-4d7e-a3ac-53753e7b31c6 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028600 Feb 08 16:34:45.613824 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 10/18] 10.222.0.35 () {64 vars in 1335 bytes} [Tue Feb 8 16:34:45 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:34:47.913396 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-37049723-7811-4a3d-9471-008daaf7b2dd admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:34:47.914396 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-37049723-7811-4a3d-9471-008daaf7b2dd admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Feb 08 16:34:47.914955 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 9/19] 10.222.0.35 () {54 vars in 930 bytes} [Tue Feb 8 16:34:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:34:47.979971 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-69be3ee5-5d2b-4ba7-b774-c589f5e8b5e1 admin admin] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:34:48.002644 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-69be3ee5-5d2b-4ba7-b774-c589f5e8b5e1 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081361 Feb 08 16:34:48.003332 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 11/20] 10.222.0.35 () {60 vars in 1291 bytes} [Tue Feb 8 16:34:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:34:50.795222 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-37049723-7811-4a3d-9471-008daaf7b2dd admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:34:50.796688 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-37049723-7811-4a3d-9471-008daaf7b2dd admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002329 Feb 08 16:34:50.797098 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 10/21] 10.222.0.35 () {54 vars in 930 bytes} [Tue Feb 8 16:34:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:34:50.858818 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-2f3d9bf9-3173-4017-91d5-a42ca00087cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "1"}} {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:34:50.876935 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-2f3d9bf9-3173-4017-91d5-a42ca00087cf admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073533 Feb 08 16:34:50.877473 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 12/22] 10.222.0.35 () {64 vars in 1282 bytes} [Tue Feb 8 16:34:50 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:34:50.890067 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-35dec935-ee61-444f-a8ef-526f4ab80c4a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:34:50.913035 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-35dec935-ee61-444f-a8ef-526f4ab80c4a admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026764 Feb 08 16:34:50.913673 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 11/23] 10.222.0.35 () {64 vars in 1332 bytes} [Tue Feb 8 16:34:50 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:34:53.258185 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-2f3d9bf9-3173-4017-91d5-a42ca00087cf admin admin] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:34:53.259187 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-2f3d9bf9-3173-4017-91d5-a42ca00087cf admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Feb 08 16:34:53.259590 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 13/24] 10.222.0.35 () {54 vars in 930 bytes} [Tue Feb 8 16:34:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:34:53.321359 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-b9b064b5-cd9d-499c-8f41-9b367283b440 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "m1.small", "id": "2", "swap": 0, "rxtx_factor": 1.0}} {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:34:53.344469 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-b9b064b5-cd9d-499c-8f41-9b367283b440 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077846 Feb 08 16:34:53.345212 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 12/25] 10.222.0.35 () {64 vars in 1282 bytes} [Tue Feb 8 16:34:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:34:53.359769 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-bd7f782a-e5ad-4415-8993-bb2cc4f4d5fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:34:53.385408 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-bd7f782a-e5ad-4415-8993-bb2cc4f4d5fd admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029542 Feb 08 16:34:53.386152 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 14/26] 10.222.0.35 () {64 vars in 1332 bytes} [Tue Feb 8 16:34:53 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:34:55.695155 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-b9b064b5-cd9d-499c-8f41-9b367283b440 admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:34:55.696228 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-b9b064b5-cd9d-499c-8f41-9b367283b440 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 Feb 08 16:34:55.696633 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 13/27] 10.222.0.35 () {54 vars in 930 bytes} [Tue Feb 8 16:34:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:34:55.755065 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-2a8446d3-c0ba-4c9b-b217-56a2dc904e6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "3", "swap": 0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 2, "name": "m1.medium"}} {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:34:55.773766 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-2a8446d3-c0ba-4c9b-b217-56a2dc904e6e admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071348 Feb 08 16:34:55.774311 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 15/28] 10.222.0.35 () {64 vars in 1282 bytes} [Tue Feb 8 16:34:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:34:55.786028 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-568088b9-0535-40b7-af9e-56cfd9e8cee0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:34:55.809167 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-568088b9-0535-40b7-af9e-56cfd9e8cee0 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027046 Feb 08 16:34:55.809856 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 14/29] 10.222.0.35 () {64 vars in 1332 bytes} [Tue Feb 8 16:34:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:34:58.101920 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-2a8446d3-c0ba-4c9b-b217-56a2dc904e6e admin admin] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:34:58.102930 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-2a8446d3-c0ba-4c9b-b217-56a2dc904e6e admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Feb 08 16:34:58.103327 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 16/30] 10.222.0.35 () {54 vars in 930 bytes} [Tue Feb 8 16:34:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:34:58.177209 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-ce84d6d0-f562-4c5b-a89a-666f38450bbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "swap": 0, "os-flavor-access:is_public": true, "disk": 80, "rxtx_factor": 1.0}} {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:34:58.197643 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-ce84d6d0-f562-4c5b-a89a-666f38450bbe admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.088152 Feb 08 16:34:58.198202 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 15/31] 10.222.0.35 () {64 vars in 1282 bytes} [Tue Feb 8 16:34:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:34:58.211287 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-50a3223e-73db-4785-861f-d7a1e18a90f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:34:58.237802 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-50a3223e-73db-4785-861f-d7a1e18a90f2 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029581 Feb 08 16:34:58.238477 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 17/32] 10.222.0.35 () {64 vars in 1332 bytes} [Tue Feb 8 16:34:58 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:35:00.572277 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-ce84d6d0-f562-4c5b-a89a-666f38450bbe admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:00.573987 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-ce84d6d0-f562-4c5b-a89a-666f38450bbe admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002305 Feb 08 16:35:00.579607 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 16/33] 10.222.0.35 () {54 vars in 930 bytes} [Tue Feb 8 16:35:00 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:35:00.685842 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-1f37844f-faa6-47d8-a23e-83e4e057c19f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.xlarge", "id": "5", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "disk": 160}} {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:35:00.707045 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-1f37844f-faa6-47d8-a23e-83e4e057c19f admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.125457 Feb 08 16:35:00.707980 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 18/34] 10.222.0.35 () {64 vars in 1282 bytes} [Tue Feb 8 16:35:00 2022] POST /compute/v2.1/flavors => generated 408 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:35:00.719002 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-cbfbcc5b-0504-4784-804d-3e6606824b5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:35:00.743367 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-cbfbcc5b-0504-4784-804d-3e6606824b5b admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027884 Feb 08 16:35:00.744456 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 17/35] 10.222.0.35 () {64 vars in 1332 bytes} [Tue Feb 8 16:35:00 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:35:23.168988 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-1f37844f-faa6-47d8-a23e-83e4e057c19f admin admin] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:23.170295 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-1f37844f-faa6-47d8-a23e-83e4e057c19f admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001780 Feb 08 16:35:23.170724 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 19/36] 10.222.0.35 () {54 vars in 930 bytes} [Tue Feb 8 16:35:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:35:23.227094 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-0faef047-c5f2-4005-958e-9fb61b525fb0 admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:23.244625 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-0faef047-c5f2-4005-958e-9fb61b525fb0 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067479 Feb 08 16:35:23.245157 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 18/37] 10.222.0.35 () {60 vars in 1291 bytes} [Tue Feb 8 16:35:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:35:24.626494 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-1f37844f-faa6-47d8-a23e-83e4e057c19f admin admin] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:24.627497 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-1f37844f-faa6-47d8-a23e-83e4e057c19f admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 Feb 08 16:35:24.627944 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 20/38] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Feb 8 16:35:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:35:24.829045 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-c835174b-59c5-45c9-9a89-0fda7d535f51 admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:24.835121 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.wsgi [None req-c835174b-59c5-45c9-9a89-0fda7d535f51 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 08 16:35:24.835634 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-c835174b-59c5-45c9-9a89-0fda7d535f51 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:35:24.836477 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-c835174b-59c5-45c9-9a89-0fda7d535f51 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058241 Feb 08 16:35:24.837452 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 19/39] 10.222.0.35 () {60 vars in 1190 bytes} [Tue Feb 8 16:35:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:24.847539 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-dd25dfe2-62ee-4a4b-9ca8-563cd616a53f admin admin] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:24.868157 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-dd25dfe2-62ee-4a4b-9ca8-563cd616a53f admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024932 Feb 08 16:35:24.868695 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 21/40] 10.222.0.35 () {60 vars in 1210 bytes} [Tue Feb 8 16:35:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:35:24.878297 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-4e79efbb-179b-4b8f-9120-4a02800e6550 admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:24.900329 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-4e79efbb-179b-4b8f-9120-4a02800e6550 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025666 Feb 08 16:35:24.900865 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 20/41] 10.222.0.35 () {60 vars in 1210 bytes} [Tue Feb 8 16:35:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:35:24.910008 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-491f4e4c-d0af-4206-a83d-543f24f3798f admin admin] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:24.915388 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.wsgi [None req-491f4e4c-d0af-4206-a83d-543f24f3798f admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 08 16:35:24.915986 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-491f4e4c-d0af-4206-a83d-543f24f3798f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:35:24.916759 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-491f4e4c-d0af-4206-a83d-543f24f3798f admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010373 Feb 08 16:35:24.917243 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 22/42] 10.222.0.35 () {60 vars in 1190 bytes} [Tue Feb 8 16:35:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:26.205913 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-4e79efbb-179b-4b8f-9120-4a02800e6550 admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:26.206919 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-4e79efbb-179b-4b8f-9120-4a02800e6550 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Feb 08 16:35:26.207318 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 21/43] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Feb 8 16:35:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:35:26.406617 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-c9b59b77-661b-4267-bfa7-0dafab6ad3ce admin admin] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:26.412875 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.wsgi [None req-c9b59b77-661b-4267-bfa7-0dafab6ad3ce admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 08 16:35:26.413472 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-c9b59b77-661b-4267-bfa7-0dafab6ad3ce admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:35:26.414196 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-c9b59b77-661b-4267-bfa7-0dafab6ad3ce admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059364 Feb 08 16:35:26.414687 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 23/44] 10.222.0.35 () {60 vars in 1190 bytes} [Tue Feb 8 16:35:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:26.423981 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-3ebb726a-ce29-45aa-b814-a1e6b1292ff1 admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:26.440572 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-3ebb726a-ce29-45aa-b814-a1e6b1292ff1 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020169 Feb 08 16:35:26.441123 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 22/45] 10.222.0.35 () {60 vars in 1210 bytes} [Tue Feb 8 16:35:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:35:26.450481 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-8c275f4d-96d2-4fa0-bf8b-92af58529c48 admin admin] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:26.464549 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-8c275f4d-96d2-4fa0-bf8b-92af58529c48 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017533 Feb 08 16:35:26.465073 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 24/46] 10.222.0.35 () {60 vars in 1210 bytes} [Tue Feb 8 16:35:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:35:26.474905 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-da88bf2a-897f-497a-b654-f0bbfae85b08 admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:26.480087 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.wsgi [None req-da88bf2a-897f-497a-b654-f0bbfae85b08 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 08 16:35:26.480638 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-da88bf2a-897f-497a-b654-f0bbfae85b08 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:35:26.481406 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-da88bf2a-897f-497a-b654-f0bbfae85b08 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010598 Feb 08 16:35:26.481895 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 23/47] 10.222.0.35 () {60 vars in 1190 bytes} [Tue Feb 8 16:35:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:27.775335 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-8c275f4d-96d2-4fa0-bf8b-92af58529c48 admin admin] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:27.776380 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-8c275f4d-96d2-4fa0-bf8b-92af58529c48 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Feb 08 16:35:27.776772 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 25/48] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Feb 8 16:35:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:35:27.967910 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-b1d52e67-04bd-4170-b82e-0410a840a67b admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:27.973356 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.wsgi [None req-b1d52e67-04bd-4170-b82e-0410a840a67b admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 08 16:35:27.973923 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-b1d52e67-04bd-4170-b82e-0410a840a67b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:35:27.974722 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-b1d52e67-04bd-4170-b82e-0410a840a67b admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059145 Feb 08 16:35:27.975250 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 24/49] 10.222.0.35 () {60 vars in 1193 bytes} [Tue Feb 8 16:35:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:27.984703 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-721cfe7b-6826-44f2-b178-05895aaa1f6e admin admin] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:27.999675 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-721cfe7b-6826-44f2-b178-05895aaa1f6e admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018726 Feb 08 16:35:28.000228 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 26/50] 10.222.0.35 () {60 vars in 1210 bytes} [Tue Feb 8 16:35:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:35:28.010847 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-8932da0d-7e6b-4aaa-8367-4055cb82e13d admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:28.024520 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-8932da0d-7e6b-4aaa-8367-4055cb82e13d admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017608 Feb 08 16:35:28.025099 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 25/51] 10.222.0.35 () {60 vars in 1210 bytes} [Tue Feb 8 16:35:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:35:28.035183 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-1e42c780-0b04-4d8a-87ff-362491689016 admin admin] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:28.040455 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.wsgi [None req-1e42c780-0b04-4d8a-87ff-362491689016 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 08 16:35:28.041014 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-1e42c780-0b04-4d8a-87ff-362491689016 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:35:28.041794 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-1e42c780-0b04-4d8a-87ff-362491689016 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010768 Feb 08 16:35:28.042279 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 27/52] 10.222.0.35 () {60 vars in 1193 bytes} [Tue Feb 8 16:35:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 08 16:35:29.349643 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-8932da0d-7e6b-4aaa-8367-4055cb82e13d admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:29.350651 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-8932da0d-7e6b-4aaa-8367-4055cb82e13d admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Feb 08 16:35:29.351072 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 26/53] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Feb 8 16:35:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:35:29.545729 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-729b79e2-8de1-40ad-b056-d37ecf4e7fee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:35:29.564388 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-729b79e2-8de1-40ad-b056-d37ecf4e7fee admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070433 Feb 08 16:35:29.564920 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 28/54] 10.222.0.35 () {64 vars in 1235 bytes} [Tue Feb 8 16:35:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:35:30.838685 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-8932da0d-7e6b-4aaa-8367-4055cb82e13d admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:30.839693 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-8932da0d-7e6b-4aaa-8367-4055cb82e13d admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Feb 08 16:35:30.840123 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 27/55] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Feb 8 16:35:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:35:31.031689 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-804ce93d-ff3e-403c-bf2f-b9da18c64199 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:35:31.050049 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-804ce93d-ff3e-403c-bf2f-b9da18c64199 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069936 Feb 08 16:35:31.050507 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 29/56] 10.222.0.35 () {64 vars in 1235 bytes} [Tue Feb 8 16:35:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 08 16:35:32.349653 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-8932da0d-7e6b-4aaa-8367-4055cb82e13d admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:32.350684 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-8932da0d-7e6b-4aaa-8367-4055cb82e13d admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Feb 08 16:35:32.351112 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 28/57] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Feb 8 16:35:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:35:32.546933 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-45a99eb4-09aa-49a4-9b54-9175f092fa11 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:35:32.565006 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-45a99eb4-09aa-49a4-9b54-9175f092fa11 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069642 Feb 08 16:35:32.565585 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 30/58] 10.222.0.35 () {64 vars in 1235 bytes} [Tue Feb 8 16:35:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:35:33.849363 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-8932da0d-7e6b-4aaa-8367-4055cb82e13d admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:33.850363 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-8932da0d-7e6b-4aaa-8367-4055cb82e13d admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Feb 08 16:35:33.850766 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 29/59] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Feb 8 16:35:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:35:34.052876 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-9ca98391-3e82-44df-9d63-f367b83c6029 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:35:34.070516 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-9ca98391-3e82-44df-9d63-f367b83c6029 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.072543 Feb 08 16:35:34.070980 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 31/60] 10.222.0.35 () {64 vars in 1235 bytes} [Tue Feb 8 16:35:33 2022] POST /compute/v2.1/flavors => generated 409 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:35:35.367687 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-8932da0d-7e6b-4aaa-8367-4055cb82e13d admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:35.368790 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-8932da0d-7e6b-4aaa-8367-4055cb82e13d admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Feb 08 16:35:35.369182 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 30/61] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Feb 8 16:35:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:35:35.559904 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-2dbf6891-696d-4696-bade-6236daeea403 admin admin] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:35:35.582133 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-2dbf6891-696d-4696-bade-6236daeea403 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.075008 Feb 08 16:35:35.582606 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 32/62] 10.222.0.35 () {60 vars in 1202 bytes} [Tue Feb 8 16:35:35 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:36:22.171151 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-8932da0d-7e6b-4aaa-8367-4055cb82e13d admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:36:22.172183 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-8932da0d-7e6b-4aaa-8367-4055cb82e13d admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Feb 08 16:36:22.172588 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 31/63] 10.222.0.35 () {54 vars in 930 bytes} [Tue Feb 8 16:36:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:36:22.228990 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-64671c32-0337-4826-b5ed-9d8d5d943ab0 admin admin] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:36:22.247963 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-64671c32-0337-4826-b5ed-9d8d5d943ab0 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069513 Feb 08 16:36:22.248502 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 33/64] 10.222.0.35 () {60 vars in 1291 bytes} [Tue Feb 8 16:36:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:36:22.271605 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-795bb9fa-e8f0-41f4-b098-06922bd8244b admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:36:22.279303 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-795bb9fa-e8f0-41f4-b098-06922bd8244b admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011438 Feb 08 16:36:22.279851 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 32/65] 10.222.0.35 () {60 vars in 1282 bytes} [Tue Feb 8 16:36:22 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:36:22.291552 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-5dfde40f-0f18-41f0-8ec9-fb0febc2d394 admin admin] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:36:22.299137 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-5dfde40f-0f18-41f0-8ec9-fb0febc2d394 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011076 Feb 08 16:36:22.299641 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 34/66] 10.222.0.35 () {60 vars in 1285 bytes} [Tue Feb 8 16:36:22 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:36:22.311312 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-148b06ac-3e09-4b15-93c0-36f6b52b917d admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:36:22.318919 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-148b06ac-3e09-4b15-93c0-36f6b52b917d admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011130 Feb 08 16:36:22.319443 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 33/67] 10.222.0.35 () {60 vars in 1285 bytes} [Tue Feb 8 16:36:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:36:22.331544 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-fd8e1e46-ee03-48ae-aca2-9e3646c0eb39 admin admin] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:36:22.339052 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-fd8e1e46-ee03-48ae-aca2-9e3646c0eb39 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011080 Feb 08 16:36:22.339561 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 35/68] 10.222.0.35 () {60 vars in 1282 bytes} [Tue Feb 8 16:36:22 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:37:56.222692 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-750a2f6d-3042-4438-8a5e-a039bb988dc1 tempest-verify_tempest_config-1150947713 tempest-verify_tempest_config-1150947713-project] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:37:56.224713 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-750a2f6d-3042-4438-8a5e-a039bb988dc1 tempest-verify_tempest_config-1150947713 tempest-verify_tempest_config-1150947713-project] 10.222.0.35 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106856 Feb 08 16:37:56.225357 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 34/69] 10.222.0.35 () {58 vars in 1133 bytes} [Tue Feb 8 16:37:56 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:39:32.792653 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-fd8e1e46-ee03-48ae-aca2-9e3646c0eb39 admin admin] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:39:32.793684 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-fd8e1e46-ee03-48ae-aca2-9e3646c0eb39 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Feb 08 16:39:32.794063 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 36/70] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Feb 8 16:39:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:39:33.051338 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-879c1f8b-ab29-4429-b83a-0756b7cc89ec admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:39:33.052534 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:39:33.052534 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: warnings.warn(msg) Feb 08 16:39:33.054064 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_concurrency.lockutils [None req-879c1f8b-ab29-4429-b83a-0756b7cc89ec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:39:33.054508 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_concurrency.lockutils [None req-879c1f8b-ab29-4429-b83a-0756b7cc89ec admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:39:33.055858 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_concurrency.lockutils [None req-879c1f8b-ab29-4429-b83a-0756b7cc89ec admin admin] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:39:33.056291 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_concurrency.lockutils [None req-879c1f8b-ab29-4429-b83a-0756b7cc89ec admin admin] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:39:33.090068 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-879c1f8b-ab29-4429-b83a-0756b7cc89ec admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.151538 Feb 08 16:39:33.090807 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 35/71] 10.222.0.35 () {60 vars in 1193 bytes} [Tue Feb 8 16:39:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:39:34.408763 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-fd8e1e46-ee03-48ae-aca2-9e3646c0eb39 admin admin] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:39:34.409833 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-fd8e1e46-ee03-48ae-aca2-9e3646c0eb39 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Feb 08 16:39:34.410267 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 37/72] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Feb 8 16:39:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:39:34.604634 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-af460c49-2bdc-448b-b7dd-376835c0df29 admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:39:34.605787 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:39:34.605787 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: warnings.warn(msg) Feb 08 16:39:34.607309 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_concurrency.lockutils [None req-af460c49-2bdc-448b-b7dd-376835c0df29 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:39:34.607844 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_concurrency.lockutils [None req-af460c49-2bdc-448b-b7dd-376835c0df29 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:39:34.608608 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_concurrency.lockutils [None req-af460c49-2bdc-448b-b7dd-376835c0df29 admin admin] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:39:34.609035 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_concurrency.lockutils [None req-af460c49-2bdc-448b-b7dd-376835c0df29 admin admin] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:39:34.628216 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-af460c49-2bdc-448b-b7dd-376835c0df29 admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075908 Feb 08 16:39:34.628771 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 36/73] 10.222.0.35 () {60 vars in 1193 bytes} [Tue Feb 8 16:39:34 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:39:46.371627 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-fd8e1e46-ee03-48ae-aca2-9e3646c0eb39 admin admin] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:39:46.372642 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-fd8e1e46-ee03-48ae-aca2-9e3646c0eb39 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Feb 08 16:39:46.373032 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 38/74] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Feb 8 16:39:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:39:46.568456 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-e1561286-c19b-4b97-9e32-91e1e75d533d admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:39:46.569605 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:39:46.569605 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: warnings.warn(msg) Feb 08 16:39:46.571712 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_concurrency.lockutils [None req-e1561286-c19b-4b97-9e32-91e1e75d533d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:39:46.572250 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_concurrency.lockutils [None req-e1561286-c19b-4b97-9e32-91e1e75d533d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:39:46.573046 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_concurrency.lockutils [None req-e1561286-c19b-4b97-9e32-91e1e75d533d admin admin] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:39:46.573494 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_concurrency.lockutils [None req-e1561286-c19b-4b97-9e32-91e1e75d533d admin admin] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:39:46.598078 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-e1561286-c19b-4b97-9e32-91e1e75d533d admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079804 Feb 08 16:39:46.598639 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 37/75] 10.222.0.35 () {60 vars in 1193 bytes} [Tue Feb 8 16:39:46 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:39:47.944779 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: DEBUG nova.api.openstack.wsgi [None req-fd8e1e46-ee03-48ae-aca2-9e3646c0eb39 admin admin] Calling method '>' {{(pid=108449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:39:47.946348 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: INFO nova.api.openstack.requestlog [None req-fd8e1e46-ee03-48ae-aca2-9e3646c0eb39 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Feb 08 16:39:47.946781 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: [pid: 108449|app: 0|req: 39/76] 10.222.0.35 () {56 vars in 1074 bytes} [Tue Feb 8 16:39:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:39:48.140743 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG nova.api.openstack.wsgi [None req-ba362946-c525-401d-981a-bb1362a469e6 admin admin] Calling method '>' {{(pid=108450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:39:48.141925 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:39:48.141925 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: warnings.warn(msg) Feb 08 16:39:48.143458 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_concurrency.lockutils [None req-ba362946-c525-401d-981a-bb1362a469e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:39:48.143923 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_concurrency.lockutils [None req-ba362946-c525-401d-981a-bb1362a469e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:39:48.144754 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_concurrency.lockutils [None req-ba362946-c525-401d-981a-bb1362a469e6 admin admin] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:39:48.145181 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: DEBUG oslo_concurrency.lockutils [None req-ba362946-c525-401d-981a-bb1362a469e6 admin admin] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:39:48.166401 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: INFO nova.api.openstack.requestlog [None req-ba362946-c525-401d-981a-bb1362a469e6 admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077067 Feb 08 16:39:48.166877 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: [pid: 108450|app: 0|req: 38/77] 10.222.0.35 () {60 vars in 1193 bytes} [Tue Feb 8 16:39:48 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:40:48.464763 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: Tue Feb 8 16:40:48 2022 - graceful shutdown triggered... Feb 08 16:40:48.465323 dv-cinder-827860-2-iscsi devstack@n-api.service[108450]: Gracefully killing worker 2 (pid: 108450)... Feb 08 16:40:48.465923 dv-cinder-827860-2-iscsi devstack@n-api.service[108449]: Gracefully killing worker 1 (pid: 108449)... Feb 08 16:40:48.467052 dv-cinder-827860-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 08 16:40:49.465885 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: worker 1 buried after 1 seconds Feb 08 16:40:49.465885 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: worker 2 buried after 1 seconds Feb 08 16:40:49.466445 dv-cinder-827860-2-iscsi devstack@n-api.service[108448]: goodbye to uWSGI. Feb 08 16:40:49.467479 dv-cinder-827860-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Feb 08 16:40:49.468077 dv-cinder-827860-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 08 16:40:49.470788 dv-cinder-827860-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 08 16:40:49.484391 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 08 16:40:49.486395 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Feb 8 16:40:49 2022] *** Feb 08 16:40:49.486395 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 08 16:40:49.486395 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 08 16:40:49.486395 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: nodename: dv-cinder-827860-2-iscsi Feb 08 16:40:49.486395 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: machine: x86_64 Feb 08 16:40:49.486395 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: clock source: unix Feb 08 16:40:49.486395 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: pcre jit disabled Feb 08 16:40:49.486395 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: detected number of CPU cores: 4 Feb 08 16:40:49.486395 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: current working directory: / Feb 08 16:40:49.486395 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: detected binary path: /usr/bin/uwsgi-core Feb 08 16:40:49.487113 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: your processes number limit is 47680 Feb 08 16:40:49.487113 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: your memory page size is 4096 bytes Feb 08 16:40:49.487113 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: detected max file descriptor number: 2048 Feb 08 16:40:49.487113 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: lock engine: pthread robust mutexes Feb 08 16:40:49.487113 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: thunder lock: enabled Feb 08 16:40:49.487113 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 08 16:40:49.487113 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 08 16:40:49.532938 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: Python main interpreter initialized at 0x562b585c99c0 Feb 08 16:40:49.532938 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: python threads support enabled Feb 08 16:40:49.532938 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: your server socket listen backlog is limited to 100 connections Feb 08 16:40:49.532938 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: your mercy for graceful operations on workers is 90 seconds Feb 08 16:40:49.533411 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: mapped 403077 bytes (393 KB) for 2 cores Feb 08 16:40:49.533411 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: *** Operational MODE: preforking *** Feb 08 16:40:49.533650 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: *** uWSGI is running in multiple interpreter mode *** Feb 08 16:40:49.533650 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: spawned uWSGI master process (pid: 122885) Feb 08 16:40:49.533861 dv-cinder-827860-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 08 16:40:49.535921 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: spawned uWSGI worker 1 (pid: 122901, cores: 1) Feb 08 16:40:49.535921 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: spawned uWSGI worker 2 (pid: 122902, cores: 1) Feb 08 16:40:49.535921 dv-cinder-827860-2-iscsi devstack@n-api.service[122885]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 08 16:40:51.601583 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 16:40:51.601583 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: from cryptography.utils import int_from_bytes Feb 08 16:40:51.602952 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 16:40:51.602952 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: from cryptography.utils import int_from_bytes Feb 08 16:40:51.635513 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 16:40:51.635513 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: from cryptography.utils import int_from_bytes Feb 08 16:40:51.636216 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 16:40:51.636216 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: from cryptography.utils import int_from_bytes Feb 08 16:40:54.065268 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 08 16:40:54.065803 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 08 16:40:54.066085 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 08 16:40:54.066421 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 08 16:40:54.066682 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 08 16:40:54.067085 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.067422 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.067772 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.068107 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.068453 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.068779 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.069113 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.069441 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.069781 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.070302 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.070663 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.071147 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-827860-2-iscsi {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.071490 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.071843 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.072170 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.072499 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.072821 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.073158 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.073478 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.073989 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.075612 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.075612 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.075612 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.075907 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.076096 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.079569 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.079569 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.079569 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.079569 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.079569 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.079569 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-827860-2-iscsi {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.079569 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.079569 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.080312 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.080312 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.080312 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.080312 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.080583 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.080954 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.081106 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.081328 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.081657 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.081986 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.082311 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.082622 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.082935 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.083253 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.083579 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.083920 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.084232 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.084486 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.084803 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.085133 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.085460 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.086314 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.086585 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.086844 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.087140 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.087534 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.087866 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.088186 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.088504 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.088817 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.089129 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.089443 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.089757 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.090068 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.091689 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.091689 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.091689 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.091689 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.092371 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.092371 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.092667 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.092825 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.093142 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.093475 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.093797 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.094131 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.094466 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.094788 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.095108 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.095429 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.095842 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.096135 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.096456 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.096717 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.097030 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.097349 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.097686 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.098004 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.098324 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.098649 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.098962 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.099276 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.099666 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.099951 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.100273 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.100591 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.100907 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.101226 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.102112 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.102435 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.102768 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.103098 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.103419 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.103739 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.104079 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.104398 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.104732 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.105052 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.105370 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.105704 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.106022 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.106581 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.106756 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.106969 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.107287 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.107623 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.108104 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.108277 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 08 16:40:54.108876 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.109032 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 08 16:40:54.109224 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.109224 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.109613 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 08 16:40:54.109784 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.110035 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 08 16:40:54.110223 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.110399 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 08 16:40:54.110557 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.110710 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.110864 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.111019 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.111171 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.111405 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.111689 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.111890 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.112392 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.112562 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.112724 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.112877 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.113023 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.113180 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.113340 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.113537 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.113701 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.113848 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.114000 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.114154 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.114346 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.114517 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.114671 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.114825 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-827860-2-iscsi {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.114978 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.115134 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.115287 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.115477 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.115639 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.115820 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.115973 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.116161 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.116320 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.116511 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.116765 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.117464 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.117758 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.118217 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.118399 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.118597 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.118765 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.118946 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.119251 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.119436 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.119706 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.119706 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.120176 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.120332 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.120332 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.120639 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.120801 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.120947 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.120947 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.121298 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.122066 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.122253 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.122410 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.122565 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.122720 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.122866 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.123021 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.123175 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.123175 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.123815 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-827860-2-iscsi {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.123989 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.124145 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.124298 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.124443 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.124443 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.124741 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.124741 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.125028 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.125216 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.125528 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.125738 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.125920 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.126069 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.126214 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.126358 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.126511 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.126671 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.126925 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.127079 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.127232 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.127385 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.127577 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.127827 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.128049 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.128303 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.128463 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.128611 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.128772 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.128928 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.129086 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.129086 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.129521 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.129699 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.130609 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.130787 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.130948 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.131103 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.131257 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.131411 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.131566 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.131711 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.131929 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.132111 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.132545 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.132794 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.133052 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.133296 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.133537 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.133690 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.133844 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.134039 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.134189 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.134334 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.134479 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.134630 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.134776 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.134935 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.135081 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.135245 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.135399 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.135647 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.135964 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.136219 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.136386 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.136541 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.136686 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.136839 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.136839 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.137228 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.137383 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.137529 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.137683 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.137832 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.138024 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.138184 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.138433 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.138598 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.138744 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.138891 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.138891 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.139429 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.139745 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.139905 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.140050 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.140156 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.140326 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.140415 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.140498 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.140597 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.140683 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.140854 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.140951 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.141044 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.141130 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.141212 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.141295 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.141388 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.141473 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.141556 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.141638 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.141721 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.141813 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.141906 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.141991 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.142256 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.142353 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.142439 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.142439 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.142602 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.142686 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.142770 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.142853 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.142944 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.143042 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.143128 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.143219 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.143381 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.143478 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.143571 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.143655 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.143655 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.143898 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.144036 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.144198 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.144325 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.144415 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.144508 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.144594 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.144685 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.144769 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.144851 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.144934 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.145030 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.145115 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.145198 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.145281 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.145363 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.145446 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.145538 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.145978 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.146133 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.146269 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.146407 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.146539 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.146684 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.146816 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.146955 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.147110 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.147308 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.147417 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.147518 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.147607 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.147698 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.147832 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.147986 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.148118 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.148903 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.149115 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.149333 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.149507 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.149715 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.149865 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.149956 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.150054 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.150141 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.150277 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.150367 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.150459 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.150552 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.150646 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.150731 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.150815 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.150906 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.150998 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.151090 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.151184 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.151269 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.151359 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.151443 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.151537 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.151537 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.151701 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.151701 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.151887 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.151972 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.152073 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.152171 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.152273 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.152488 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.152581 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.152664 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.152757 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.152857 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.152951 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.153044 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.153129 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.153220 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.153313 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.153406 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.153491 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.153583 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.153675 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.153767 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.153860 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.153958 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.154051 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.154143 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.154280 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.154369 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 16:40:54.154462 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.154603 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.154758 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.154944 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.155083 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.155298 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.155404 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.155623 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.155716 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.155998 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.156157 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.156340 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.156519 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.156661 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.156812 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.156963 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.157115 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.157266 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.157458 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.157599 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.157742 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.157908 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.158054 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.158272 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.158369 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.158529 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.158677 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.158865 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.159027 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.159196 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.159355 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.159502 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.159871 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.160198 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.160354 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.160547 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.160709 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.160856 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.161001 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.161153 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.161308 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.161482 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.161630 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.161782 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.161928 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.162081 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.162236 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.162421 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.162838 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.162995 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.163099 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.163330 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.163656 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.164065 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.164401 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.164569 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.164849 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.164953 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.165173 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.165289 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.165497 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.165631 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.165831 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.165972 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.166158 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.166299 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.166544 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.166691 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.166832 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.166979 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.167110 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.167311 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.167448 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.167646 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.168816 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.168981 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.169107 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.169229 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.169343 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.169514 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.169618 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.169719 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.169805 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.169888 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.169979 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.170106 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.170245 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.170417 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.170536 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.170629 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.170723 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.170812 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.170905 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.171016 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.171113 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.171207 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.171376 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.171498 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.171696 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.171867 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.172056 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.172191 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.172391 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.172501 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.172718 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.172817 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.173050 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.173153 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.173374 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.173468 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.173699 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.173803 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.174037 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.174131 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.174367 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.174477 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.174692 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.174786 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.175016 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.175117 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.175338 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.175449 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.175660 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.175777 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.176009 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.176102 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.176328 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.176448 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.176653 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.176775 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.176974 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.177087 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.177291 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.177396 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.177609 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.177715 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.177933 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.178026 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.178246 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.178348 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.178580 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.178849 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.178964 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.179198 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.179314 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.179550 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.179648 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.179927 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.180186 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.180455 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.180564 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.180662 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.180796 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.180954 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.181148 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.181275 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.181494 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.181589 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.181826 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.181927 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.182199 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.182302 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.182530 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.182624 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.182855 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.183005 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.183178 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.183274 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.183507 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.183609 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.183844 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.183958 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.184167 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.184260 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.184480 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.184571 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.184795 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.184898 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.185110 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.185204 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.185426 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.185518 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.185737 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.185830 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.186053 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.186155 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.186367 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.186464 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.186695 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.186830 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.186999 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.187147 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.187313 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.187414 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.187646 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.187860 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.188009 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.188165 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.188311 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.188463 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.188696 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.188848 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.188996 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.189143 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.189293 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.189446 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.189623 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.189759 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.189902 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.190052 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.190203 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.190352 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.190513 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.190665 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.190834 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.190937 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.191152 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.191255 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.191473 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.191646 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.191808 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.191903 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.192130 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.192231 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.192445 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.192544 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.192769 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.192862 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.193093 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.193198 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.193412 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.193503 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.193727 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.193826 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.194046 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.194138 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.194363 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.194455 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.194682 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.194780 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.194995 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.195605 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.195893 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.196081 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.196259 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.196483 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.196672 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.196838 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.196991 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.197154 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.197296 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.197452 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.197675 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.197910 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.198064 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.198211 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.198353 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.198514 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.198659 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.198809 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.198964 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.199108 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.199259 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.199410 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.199553 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.199714 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.199842 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.199932 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.200017 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.200216 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.200312 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.200540 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.200650 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.200864 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.200982 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.201178 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.201283 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.201517 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.201618 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.201830 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.201937 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.202146 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.202239 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.202466 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.202561 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.202790 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.202896 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.203119 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.203266 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.203426 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.203522 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.203783 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.203943 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.204096 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.204188 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.204418 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.204513 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.204734 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.204828 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.205047 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.205139 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.205362 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.205454 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.205680 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.205780 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.205993 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.206094 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.206311 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.206402 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.206630 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.206726 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.206943 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.207036 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.207256 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.207350 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.207571 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.207666 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.207910 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.208091 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.208252 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.208410 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.208566 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.208718 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.208859 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.209002 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.209151 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.209310 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.209453 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.209597 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.209802 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.209948 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.210098 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.210200 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.210410 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.210501 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.210816 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.210972 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.211187 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.211373 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.211569 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.211676 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.211957 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.212061 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.212271 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.212372 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.212595 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.212686 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.212914 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.213007 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.213259 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.213423 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.213568 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.213660 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.213901 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.213999 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.214217 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.214317 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.214534 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.214634 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.214851 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.214952 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.215173 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.215266 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.215494 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.215593 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.215841 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.215936 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.216164 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.216258 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.216485 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.216583 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.216808 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.216928 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.217128 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.217431 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.217431 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.217611 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.217751 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.217854 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.218069 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.218169 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.218388 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.218487 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.218705 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.218882 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.219020 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.219121 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.219338 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.219429 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.219662 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.219829 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.220013 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.220287 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.220417 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.220632 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.220763 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.220950 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.221071 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.221267 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.221395 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.221594 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.221795 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.221924 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.222044 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.222217 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.222336 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.222540 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.222671 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.222858 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.222992 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.223180 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.223301 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.223496 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.223625 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.223858 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.224018 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.224163 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.224296 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.224488 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.224594 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.224804 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.224909 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.225120 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.225221 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.225436 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.225529 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.225756 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.225848 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.226071 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.226164 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.226996 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.227113 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.227298 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.227647 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.227768 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.228023 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.228120 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.228340 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.228438 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.228664 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.228765 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.228977 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.229076 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.229296 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.229389 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.229616 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.229716 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.229933 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.230025 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.230248 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.230349 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.230563 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.230657 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.230879 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.230977 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.231217 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.231322 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.231537 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.231637 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.231898 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.232007 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.232253 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.232355 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.232571 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.232671 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.232887 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.232988 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.233229 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.233367 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.233544 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.233693 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.233843 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.234018 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.234158 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.234355 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.234491 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.234690 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.234783 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.235027 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.235128 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.235348 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.235448 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.235681 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.235850 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.236031 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.236135 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.236347 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.236448 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.236661 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.236766 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.236978 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.237085 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.237292 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.237390 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.237630 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.237749 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.237930 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.238041 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.238243 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.238389 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.238557 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.238650 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.238877 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.238979 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.239193 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.239308 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.239504 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.239643 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.239846 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.239993 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.240162 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.240328 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.240487 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.240665 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.240802 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.240985 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.241116 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.241303 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.241429 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.241626 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.241748 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.242514 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.242647 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.242936 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.243110 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.243268 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.243363 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.243586 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.243690 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.243937 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.244043 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.244254 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.244355 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.244581 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.244711 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.244894 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.245004 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.245209 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.245345 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.245528 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.245643 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.245843 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.245946 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.246173 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.246276 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.246485 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.246598 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.246806 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.246925 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.247121 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.247257 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.247481 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.247606 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.247746 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.247936 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.248084 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.248187 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.248397 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.248491 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.248709 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.248877 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.249022 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.249124 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.249336 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.249429 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.249647 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.249755 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.249977 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.250070 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.250295 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.250400 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.250604 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.250698 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.250917 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.251010 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.251229 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.251329 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.251586 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.251702 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.251926 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.252031 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.252273 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.252378 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.252590 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.252685 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.252912 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.253015 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.253229 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.253338 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.253549 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.253642 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.253863 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.253964 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.254179 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.254287 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.254492 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.254621 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.254810 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.254912 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.255124 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.255234 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.255440 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.255542 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.255770 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.255878 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.256087 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.256191 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.256417 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.256512 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.256738 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.256852 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.257072 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.257171 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.257732 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.257867 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.258003 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.258200 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.258321 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.258515 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.258634 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.258845 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.258941 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.259164 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.259260 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.259513 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.259607 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.259866 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.259978 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.260187 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.260291 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.260509 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.260604 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.260831 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.260936 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.261148 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.261284 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.261469 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.261601 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.261791 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.261931 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.262105 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.262241 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.262424 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.262548 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.262743 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.262881 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.263058 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.263189 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.263384 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.263514 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.263701 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.263843 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.264043 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.264181 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.264361 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.264492 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.264675 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.264808 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.264994 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.265254 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.265386 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.265599 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.265744 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.265930 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.266062 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.266265 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.266389 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.266578 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.266713 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.266905 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.267028 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.267233 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.267373 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.267559 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.267667 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.267908 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.268016 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.268231 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.268455 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.268692 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.268852 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.269003 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.269147 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.269290 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.269443 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.269653 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.269800 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.269943 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.270085 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.270227 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.270378 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.270546 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.270690 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.270833 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.270975 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.271124 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.271353 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.271506 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.271659 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.271829 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.271969 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.272112 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.272262 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.272419 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.272571 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.272667 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.272761 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.273041 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.273164 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.273401 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.273520 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.273716 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.273813 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.274126 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.274289 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.274427 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.274532 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.274751 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.274852 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.275073 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.275168 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.275399 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.275500 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.275723 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.275912 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.276072 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.276168 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.276397 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.276501 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.276710 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.276814 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.277042 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.277138 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.277377 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.277639 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.277738 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.277835 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.278094 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.278219 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.278322 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.278551 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.278647 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.278905 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.279060 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.279246 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.279348 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.279572 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.279678 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.279927 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.280022 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.280260 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.280354 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.280602 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.280712 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.280924 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.281018 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.281246 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.281337 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.281572 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.281684 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.281890 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.281982 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.282207 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.282298 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.282518 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.282619 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.282834 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.282931 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.283159 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.283250 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.283471 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.283571 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.283812 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.283911 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.284133 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.284358 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.284462 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.284719 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.284821 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.285050 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.285151 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.285379 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.285485 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.285693 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.285817 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.286024 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.286119 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.286345 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.286438 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.286677 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.286783 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.286996 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.287097 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.287307 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.287422 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.287639 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.287780 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.287979 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.288152 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.288298 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.288478 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.288614 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.289335 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.289535 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.289695 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.290037 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.290213 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.290359 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.290505 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.290647 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.290800 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.290949 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.291106 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.291247 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.291399 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.291542 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.291692 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.291882 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.292024 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.292167 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.292315 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.292460 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.292570 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.292657 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.292741 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.292977 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.293077 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.293288 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.293390 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.293598 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.293689 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.293917 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.294012 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.294230 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.294336 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.294543 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.294637 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.294856 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.294957 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.295172 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.295268 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.295484 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.295586 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.295819 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.295930 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.296133 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.296227 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.296463 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.296564 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.296774 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.296877 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.297106 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.297202 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.297421 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.297559 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.297774 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.297906 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.298022 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.298135 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.298330 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.298481 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.298683 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.298840 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.298994 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.299102 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.299337 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.299427 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.299661 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.299925 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.300020 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.300277 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.300382 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.300611 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.300704 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.300958 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.301053 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.301282 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.301387 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.301607 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.301709 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.301923 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.302019 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.302242 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.302342 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.302565 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.302664 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.302891 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.302991 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.303217 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.303309 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.303535 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.303636 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.303882 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.303979 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.304207 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.304308 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.305127 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.305680 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.305839 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.305958 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.306074 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.306197 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.306327 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.306451 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.306624 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.306744 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.306857 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.306970 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.307175 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.307299 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.307531 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.307662 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.307886 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.308028 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.308206 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.308339 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.308527 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.308655 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.308881 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.309013 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.309170 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.309292 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.309562 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.309705 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.309821 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.309948 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.310132 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.310254 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.310464 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.310586 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.310786 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.310925 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.311580 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.311683 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.311851 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.311964 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.312061 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.312157 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.312244 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.312329 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.312420 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.312585 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.312717 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.312812 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.313045 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.313149 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.313372 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.313477 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.313698 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.313791 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.314022 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.314129 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.314345 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.314448 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.314669 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.314763 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.314990 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.315092 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.315356 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.315459 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.315632 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.315725 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.315983 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.316077 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.316317 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.316413 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.316663 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.316756 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.316990 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.317091 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.317311 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.317404 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.317636 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.317737 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.317964 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.318109 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.318300 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.318499 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.318676 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.318826 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.318942 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.319166 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.319272 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.319504 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.319617 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.319881 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.320012 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.320278 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.320429 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.320612 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.320753 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.320930 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.321035 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.321269 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.321403 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.321558 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.321686 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.321881 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.322013 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.322199 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.322339 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.322515 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.322665 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.322847 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.322989 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.323174 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.323310 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.323487 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.323652 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.323843 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.324020 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.324166 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.324341 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.324681 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.324773 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.325015 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.325117 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.325347 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.325487 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.325677 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.325781 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.326002 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.326098 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.326326 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.326416 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.326643 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.326748 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.326981 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.327093 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.327298 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.327392 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.327614 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.327722 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.327994 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.328154 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.328317 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.328410 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.328634 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.328746 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.328949 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.329043 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.329271 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.329364 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.329591 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.329693 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.329906 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.330003 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.330226 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.330321 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.330540 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.330636 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.330877 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.330969 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.331194 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.331343 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.331551 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.331654 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.331835 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.331947 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.332146 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 08 16:40:54.332239 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.332461 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.332777 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.333098 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.333411 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.333732 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.334048 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.334366 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.334682 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.335001 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.335316 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.335658 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.336015 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.336402 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.336917 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.337032 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.337351 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.337672 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.338031 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.338406 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.338744 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.339132 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.339460 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.340045 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.340388 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.340718 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.341061 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.341403 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.341722 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.342035 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.342348 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.342680 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.343001 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.343326 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.343646 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.344000 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.344322 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.344640 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.344959 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.345281 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.345601 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.345920 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.346237 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.346562 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.346912 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.347240 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.347566 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.347915 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.348244 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.348568 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.348887 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.349206 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.349531 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.349857 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.350202 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.350783 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.350890 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.351787 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.352296 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.352462 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.352770 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.353093 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.353428 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.353768 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.354093 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.354426 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.354747 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.355088 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.355443 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.355800 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.356134 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_db.sqlalchemy.engines [None req-847d9343-c46d-417f-9fe1-e8b828896be7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 16:40:54.356245 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.356451 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.356767 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.357082 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.357401 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.357741 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.358082 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.358406 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.359649 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.359649 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.359649 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.359649 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.360012 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.360331 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.360658 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.360977 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.361319 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.361639 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.361959 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.362289 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.362599 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.362918 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.363236 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.363582 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.363945 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.364263 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.364597 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.364924 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.365252 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.365579 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.365901 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.366240 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.366561 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.367149 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.367351 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.367617 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.367973 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.368299 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.368641 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.368979 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.369316 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.369652 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.370010 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.370335 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.370700 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.371031 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.371357 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.371686 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.372026 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 16:40:54.372282 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 08 16:40:54.395364 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_db.sqlalchemy.engines [None req-2a10e5e7-0d92-4cac-b1c8-a339d1f03a05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122901) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 16:40:54.422321 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.context [None req-847d9343-c46d-417f-9fe1-e8b828896be7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d3f377b9-f250-471d-9570-5d0606368cf5(cell1) {{(pid=122902) load_cells /opt/stack/nova/nova/context.py:464}} Feb 08 16:40:54.426585 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-847d9343-c46d-417f-9fe1-e8b828896be7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:40:54.428340 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-847d9343-c46d-417f-9fe1-e8b828896be7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:40:54.429178 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-847d9343-c46d-417f-9fe1-e8b828896be7 None None] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:40:54.431153 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-847d9343-c46d-417f-9fe1-e8b828896be7 None None] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:40:54.441663 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_db.sqlalchemy.engines [None req-847d9343-c46d-417f-9fe1-e8b828896be7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 16:40:54.442907 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_db.sqlalchemy.engines [None req-847d9343-c46d-417f-9fe1-e8b828896be7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 16:40:54.461799 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.context [None req-2a10e5e7-0d92-4cac-b1c8-a339d1f03a05 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d3f377b9-f250-471d-9570-5d0606368cf5(cell1) {{(pid=122901) load_cells /opt/stack/nova/nova/context.py:464}} Feb 08 16:40:54.466165 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2a10e5e7-0d92-4cac-b1c8-a339d1f03a05 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:40:54.467803 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2a10e5e7-0d92-4cac-b1c8-a339d1f03a05 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:40:54.468627 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2a10e5e7-0d92-4cac-b1c8-a339d1f03a05 None None] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:40:54.470563 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2a10e5e7-0d92-4cac-b1c8-a339d1f03a05 None None] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:40:54.481573 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_db.sqlalchemy.engines [None req-2a10e5e7-0d92-4cac-b1c8-a339d1f03a05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122901) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 16:40:54.482945 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_db.sqlalchemy.engines [None req-2a10e5e7-0d92-4cac-b1c8-a339d1f03a05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122901) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 16:40:54.602832 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_db.sqlalchemy.engines [None req-847d9343-c46d-417f-9fe1-e8b828896be7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 16:40:54.644230 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_db.sqlalchemy.engines [None req-2a10e5e7-0d92-4cac-b1c8-a339d1f03a05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122901) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 16:40:54.930143 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: WARNING keystonemiddleware.auth_token [None req-847d9343-c46d-417f-9fe1-e8b828896be7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 08 16:40:54.936815 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: WARNING keystonemiddleware.auth_token [None req-847d9343-c46d-417f-9fe1-e8b828896be7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 08 16:40:54.967723 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: WARNING keystonemiddleware.auth_token [None req-2a10e5e7-0d92-4cac-b1c8-a339d1f03a05 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 08 16:40:54.975199 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: WARNING keystonemiddleware.auth_token [None req-2a10e5e7-0d92-4cac-b1c8-a339d1f03a05 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 08 16:40:55.304103 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: WARNING keystonemiddleware.auth_token [None req-847d9343-c46d-417f-9fe1-e8b828896be7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 08 16:40:55.310927 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: WARNING keystonemiddleware.auth_token [None req-847d9343-c46d-417f-9fe1-e8b828896be7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 08 16:40:55.316933 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: WARNING keystonemiddleware.auth_token [None req-2a10e5e7-0d92-4cac-b1c8-a339d1f03a05 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 08 16:40:55.317618 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562b585c99c0 pid: 122902 (default app) Feb 08 16:40:55.322994 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: WARNING keystonemiddleware.auth_token [None req-2a10e5e7-0d92-4cac-b1c8-a339d1f03a05 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 08 16:40:55.328768 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562b585c99c0 pid: 122901 (default app) Feb 08 16:41:31.436152 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-6f1a8242-3a83-473a-9770-2a5d5faac4c3 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Action: 'create', calling method: .version_select at 0x7fcde2098280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-874848062"}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:41:33.570840 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-04130ad5-28c4-431a-8177-7c2b88ebd817 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2017877585", "imageRef": "d70d3911-14f2-4cba-9283-bf4bef4fb526", "flavorRef": "452", "networks": [{"uuid": "401a371c-221c-42c3-b115-a08adffde4ba"}]}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:41:34.196434 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.network.neutron [None req-04130ad5-28c4-431a-8177-7c2b88ebd817 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] validate_networks() for [('401a371c-221c-42c3-b115-a08adffde4ba', None, None, None, None, None)] {{(pid=122901) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 16:41:34.455989 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-6f1a8242-3a83-473a-9770-2a5d5faac4c3 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.309824 Feb 08 16:41:34.463929 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 1/1] 10.222.0.35 () {60 vars in 1154 bytes} [Tue Feb 8 16:41:30 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4313 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 08 16:41:34.469412 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-eee15416-4ddc-49d1-a977-3a30f321c978 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde1f5be50>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:34.605646 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-eee15416-4ddc-49d1-a977-3a30f321c978 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e" status: 200 len: 344 microversion: 2.1 time: 0.140139 Feb 08 16:41:34.611030 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 2/2] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Feb 8 16:41:34 2022] GET /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e => generated 344 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:41:35.620659 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-67f9aa14-1184-4501-b4c8-d3e5a21be600 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde2098d30>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:35.769788 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-67f9aa14-1184-4501-b4c8-d3e5a21be600 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e" status: 200 len: 345 microversion: 2.1 time: 0.149250 Feb 08 16:41:35.776094 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 3/3] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Feb 8 16:41:35 2022] GET /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e => generated 345 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:41:35.785062 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-19783264-86de-4e16-be41-34196cf9c045 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Action: 'create', calling method: .version_select at 0x7fcde1ef2820>, body: {"snapshot": {"volume_id": "7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1538777510"}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:41:36.605095 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-19783264-86de-4e16-be41-34196cf9c045 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.824234 Feb 08 16:41:36.605955 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 4/4] 10.222.0.35 () {60 vars in 1161 bytes} [Tue Feb 8 16:41:35 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:41:36.618874 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-f913f130-c035-4317-84de-ac36e76da8dc tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde1efb430>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:37.063365 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-f913f130-c035-4317-84de-ac36e76da8dc tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938" status: 200 len: 287 microversion: 2.1 time: 0.451201 Feb 08 16:41:37.070040 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 5/5] 10.222.0.35 () {58 vars in 1250 bytes} [Tue Feb 8 16:41:36 2022] GET /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938 => generated 287 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:41:37.078400 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-ca572571-a0df-42c4-b8af-cdd6dd29d738 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde1f5bee0>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:37.246242 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-04130ad5-28c4-431a-8177-7c2b88ebd817 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Flavor limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 16:41:37.247582 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-04130ad5-28c4-431a-8177-7c2b88ebd817 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Image limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 16:41:37.248649 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-04130ad5-28c4-431a-8177-7c2b88ebd817 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Flavor pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 16:41:37.249503 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-04130ad5-28c4-431a-8177-7c2b88ebd817 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Image pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 16:41:37.250208 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-04130ad5-28c4-431a-8177-7c2b88ebd817 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 16:41:37.287835 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-04130ad5-28c4-431a-8177-7c2b88ebd817 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:37.290265 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-04130ad5-28c4-431a-8177-7c2b88ebd817 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:37.293073 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-04130ad5-28c4-431a-8177-7c2b88ebd817 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:37.296759 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-04130ad5-28c4-431a-8177-7c2b88ebd817 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:37.355862 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-04130ad5-28c4-431a-8177-7c2b88ebd817 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Getting quotas for project dbcf2a29fa234f62a1c82620e2c1cbcd. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:41:37.371736 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-04130ad5-28c4-431a-8177-7c2b88ebd817 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Getting quotas for user b846098f335a42e0892f7f35007ef234 and project dbcf2a29fa234f62a1c82620e2c1cbcd. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:41:37.399596 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-04130ad5-28c4-431a-8177-7c2b88ebd817 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Going to run 1 instances... {{(pid=122901) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 16:41:37.401328 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-ca572571-a0df-42c4-b8af-cdd6dd29d738 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.329961 Feb 08 16:41:37.402010 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 6/6] 10.222.0.35 () {58 vars in 1139 bytes} [Tue Feb 8 16:41:37 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:41:37.403554 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-04130ad5-28c4-431a-8177-7c2b88ebd817 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d70d3911-14f2-4cba-9283-bf4bef4fb526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122901) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 16:41:37.416145 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-fc8334d5-5b9f-4d96-ba6a-527f6b862cec tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde1efbee0>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:37.486418 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-fc8334d5-5b9f-4d96-ba6a-527f6b862cec tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938" status: 200 len: 287 microversion: 2.1 time: 0.077404 Feb 08 16:41:37.488237 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 7/7] 10.222.0.35 () {58 vars in 1250 bytes} [Tue Feb 8 16:41:37 2022] GET /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:41:37.558125 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-04130ad5-28c4-431a-8177-7c2b88ebd817 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.633861 Feb 08 16:41:37.564467 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 1/8] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Feb 8 16:41:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 4642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 16:41:37.578715 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-dab5c96a-ac43-4df7-9e05-3b278d0686fa tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:37.580352 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-dab5c96a-ac43-4df7-9e05-3b278d0686fa tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:38.260298 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-dab5c96a-ac43-4df7-9e05-3b278d0686fa tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:38.280474 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-dab5c96a-ac43-4df7-9e05-3b278d0686fa tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1215 microversion: 2.1 time: 0.707945 Feb 08 16:41:38.296127 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 8/9] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:37 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1215 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:38.490894 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-0dd885f4-d29d-4684-9fba-32c6c113475e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-877450387", "imageRef": "d70d3911-14f2-4cba-9283-bf4bef4fb526", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:41:38.502511 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c06f3df3-d3e3-42f6-8c8a-9474ca27d90e tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde1efe0d0>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:38.590847 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c06f3df3-d3e3-42f6-8c8a-9474ca27d90e tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938" status: 200 len: 287 microversion: 2.1 time: 0.093671 Feb 08 16:41:38.592496 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 9/10] 10.222.0.35 () {58 vars in 1250 bytes} [Tue Feb 8 16:41:38 2022] GET /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938 => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:41:38.604200 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.network.neutron [None req-0dd885f4-d29d-4684-9fba-32c6c113475e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] validate_networks() for [('a853a558-0896-4700-8a59-b29597b86231', None, None, None, None, None)] {{(pid=122901) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 16:41:39.299370 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-8a5be2c5-4088-4274-899a-41558c9986c5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:39.300255 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-8a5be2c5-4088-4274-899a-41558c9986c5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:39.521603 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-8a5be2c5-4088-4274-899a-41558c9986c5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:39.534427 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-8a5be2c5-4088-4274-899a-41558c9986c5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1215 microversion: 2.1 time: 0.239962 Feb 08 16:41:39.537503 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 10/11] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:39 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1215 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:39.603124 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-f53cbb43-e9fa-4042-a761-a5759d2c7767 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde1efe040>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:39.669247 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-f53cbb43-e9fa-4042-a761-a5759d2c7767 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938" status: 200 len: 287 microversion: 2.1 time: 0.070284 Feb 08 16:41:39.669982 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 11/12] 10.222.0.35 () {58 vars in 1250 bytes} [Tue Feb 8 16:41:39 2022] GET /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:41:39.909928 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-0dd885f4-d29d-4684-9fba-32c6c113475e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Flavor limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 16:41:39.910871 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-0dd885f4-d29d-4684-9fba-32c6c113475e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Image limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 16:41:39.911490 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-0dd885f4-d29d-4684-9fba-32c6c113475e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Flavor pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 16:41:39.912637 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-0dd885f4-d29d-4684-9fba-32c6c113475e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Image pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 16:41:39.913287 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-0dd885f4-d29d-4684-9fba-32c6c113475e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 16:41:39.931261 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0dd885f4-d29d-4684-9fba-32c6c113475e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:39.931713 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0dd885f4-d29d-4684-9fba-32c6c113475e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:39.932561 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0dd885f4-d29d-4684-9fba-32c6c113475e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:39.932994 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0dd885f4-d29d-4684-9fba-32c6c113475e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:39.979185 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-0dd885f4-d29d-4684-9fba-32c6c113475e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Getting quotas for project 637df1e7f2cb48c0b97d67658900335d. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:41:39.983606 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-0dd885f4-d29d-4684-9fba-32c6c113475e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Getting quotas for user 21e3f764b9f34256bc91f08bc220c7c1 and project 637df1e7f2cb48c0b97d67658900335d. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:41:39.997933 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-0dd885f4-d29d-4684-9fba-32c6c113475e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Going to run 1 instances... {{(pid=122901) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 16:41:40.000238 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-0dd885f4-d29d-4684-9fba-32c6c113475e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d70d3911-14f2-4cba-9283-bf4bef4fb526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122901) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 16:41:40.095142 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-0dd885f4-d29d-4684-9fba-32c6c113475e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.971242 Feb 08 16:41:40.098151 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 2/13] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Feb 8 16:41:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 1975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 08 16:41:40.108221 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b23d1901-0a34-4c43-95f3-9eb13a52b5f8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:40.108967 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b23d1901-0a34-4c43-95f3-9eb13a52b5f8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:40.391829 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b23d1901-0a34-4c43-95f3-9eb13a52b5f8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:40.405236 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b23d1901-0a34-4c43-95f3-9eb13a52b5f8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1221 microversion: 2.1 time: 0.300266 Feb 08 16:41:40.406541 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 12/14] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:40 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1221 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:40.553641 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-131cd0da-9a38-4014-aae8-9195a36d6fd8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:40.554279 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-131cd0da-9a38-4014-aae8-9195a36d6fd8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:40.605499 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-131cd0da-9a38-4014-aae8-9195a36d6fd8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:40.606375 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-131cd0da-9a38-4014-aae8-9195a36d6fd8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:40.616877 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-131cd0da-9a38-4014-aae8-9195a36d6fd8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:40.617768 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-131cd0da-9a38-4014-aae8-9195a36d6fd8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:40.689888 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-a2a685da-9899-477f-a3b8-44c3e08efac3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1496320726", "imageRef": "d70d3911-14f2-4cba-9283-bf4bef4fb526", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:41:40.888871 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.network.neutron [None req-a2a685da-9899-477f-a3b8-44c3e08efac3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] validate_networks() for [('a853a558-0896-4700-8a59-b29597b86231', None, None, None, None, None)] {{(pid=122902) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 16:41:41.080189 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-131cd0da-9a38-4014-aae8-9195a36d6fd8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:41.144665 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-131cd0da-9a38-4014-aae8-9195a36d6fd8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1219 microversion: 2.1 time: 0.595441 Feb 08 16:41:41.155347 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 3/15] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:40 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1219 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:41.160730 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-98eed9d2-a7a8-407b-a05e-bd140300aada tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde0e1ae50>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:41.246094 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-98eed9d2-a7a8-407b-a05e-bd140300aada tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938" status: 200 len: 287 microversion: 2.1 time: 0.089077 Feb 08 16:41:41.247649 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 4/16] 10.222.0.35 () {58 vars in 1250 bytes} [Tue Feb 8 16:41:41 2022] GET /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938 => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:41:42.137247 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-a58e6a81-0686-4661-b3fb-b6a2bfbd7b11 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Action: 'create', calling method: .version_select at 0x7fcde201c160>, body: {"keypair": {"name": "tempest-keypair-181098442"}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:41:42.231712 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-a58e6a81-0686-4661-b3fb-b6a2bfbd7b11 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Getting quotas for project 23325df6a88748fc9261e22c093ac67e. Resources: {'key_pairs'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:41:42.250647 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-a58e6a81-0686-4661-b3fb-b6a2bfbd7b11 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Getting quotas for user c858d129681846aba9e366c37c2213a0 and project 23325df6a88748fc9261e22c093ac67e. Resources: {'key_pairs'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:41:42.694209 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-a58e6a81-0686-4661-b3fb-b6a2bfbd7b11 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Getting quotas for project 23325df6a88748fc9261e22c093ac67e. Resources: {'key_pairs'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:41:42.700064 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-a58e6a81-0686-4661-b3fb-b6a2bfbd7b11 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Getting quotas for user c858d129681846aba9e366c37c2213a0 and project 23325df6a88748fc9261e22c093ac67e. Resources: {'key_pairs'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:41:42.732653 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-a58e6a81-0686-4661-b3fb-b6a2bfbd7b11 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.787839 Feb 08 16:41:42.735163 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 5/17] 10.222.0.35 () {62 vars in 1198 bytes} [Tue Feb 8 16:41:41 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 791 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 08 16:41:42.756832 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-f0d5cc81-1db5-44e2-b1f6-b4b68d889163 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:42.768637 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-f0d5cc81-1db5-44e2-b1f6-b4b68d889163 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:42.786293 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f0d5cc81-1db5-44e2-b1f6-b4b68d889163 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:42.795381 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f0d5cc81-1db5-44e2-b1f6-b4b68d889163 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:42.796418 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f0d5cc81-1db5-44e2-b1f6-b4b68d889163 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:42.799539 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f0d5cc81-1db5-44e2-b1f6-b4b68d889163 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:42.985706 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f0d5cc81-1db5-44e2-b1f6-b4b68d889163 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:42.999731 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-f0d5cc81-1db5-44e2-b1f6-b4b68d889163 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1267 microversion: 2.1 time: 0.262459 Feb 08 16:41:43.002003 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 6/18] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:42 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1267 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:43.007597 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-eb0f313b-2fa0-4ee6-973b-d951897c69f6 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde0508dc0>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:43.093015 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-eb0f313b-2fa0-4ee6-973b-d951897c69f6 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938" status: 200 len: 288 microversion: 2.1 time: 0.089563 Feb 08 16:41:43.093784 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 7/19] 10.222.0.35 () {58 vars in 1250 bytes} [Tue Feb 8 16:41:43 2022] GET /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938 => generated 288 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:41:43.204755 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-a2a685da-9899-477f-a3b8-44c3e08efac3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Flavor limits 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 16:41:43.205240 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-a2a685da-9899-477f-a3b8-44c3e08efac3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Image limits 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 16:41:43.205654 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-a2a685da-9899-477f-a3b8-44c3e08efac3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Flavor pref 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 16:41:43.206337 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-a2a685da-9899-477f-a3b8-44c3e08efac3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Image pref 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 16:41:43.206772 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-a2a685da-9899-477f-a3b8-44c3e08efac3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 16:41:43.237955 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a2a685da-9899-477f-a3b8-44c3e08efac3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:43.238913 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a2a685da-9899-477f-a3b8-44c3e08efac3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:43.240776 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a2a685da-9899-477f-a3b8-44c3e08efac3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:43.241223 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a2a685da-9899-477f-a3b8-44c3e08efac3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:43.360328 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-a2a685da-9899-477f-a3b8-44c3e08efac3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Getting quotas for project 637df1e7f2cb48c0b97d67658900335d. Resources: {'cores', 'ram', 'instances'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:41:43.384808 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-a2a685da-9899-477f-a3b8-44c3e08efac3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Getting quotas for user 21e3f764b9f34256bc91f08bc220c7c1 and project 637df1e7f2cb48c0b97d67658900335d. Resources: {'cores', 'ram', 'instances'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:41:43.422198 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-4122fd7b-9bbb-4ee9-8cf0-1d119f47dc12 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Action: 'create', calling method: .version_select at 0x7fcde04fa820>, body: {"keypair": {"name": "tempest-keypair-701831441"}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:41:43.439853 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-a2a685da-9899-477f-a3b8-44c3e08efac3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Going to run 1 instances... {{(pid=122902) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 16:41:43.442943 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-a2a685da-9899-477f-a3b8-44c3e08efac3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d70d3911-14f2-4cba-9283-bf4bef4fb526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 16:41:43.457468 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-4122fd7b-9bbb-4ee9-8cf0-1d119f47dc12 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Getting quotas for project 2214758b43e6434b8c27d97f7fd1151c. Resources: {'key_pairs'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:41:43.467731 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-4122fd7b-9bbb-4ee9-8cf0-1d119f47dc12 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Getting quotas for user c5f36415ea7148d79f9fdb9cfac129e0 and project 2214758b43e6434b8c27d97f7fd1151c. Resources: {'key_pairs'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:41:43.604403 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-a2a685da-9899-477f-a3b8-44c3e08efac3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.928728 Feb 08 16:41:43.605923 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 13/20] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Feb 8 16:41:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 2931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 08 16:41:43.617737 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c26c870d-6435-4605-a607-2dff3c9491ef tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde1e1b8b0>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:43.808595 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c26c870d-6435-4605-a607-2dff3c9491ef tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "DELETE /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938" status: 202 len: 0 microversion: 2.1 time: 0.201284 Feb 08 16:41:43.809771 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 14/21] 10.222.0.35 () {58 vars in 1253 bytes} [Tue Feb 8 16:41:43 2022] DELETE /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:41:43.815207 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-a66c3e2b-d4a3-48f3-9ecf-30406e98f730 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:43.816104 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-a66c3e2b-d4a3-48f3-9ecf-30406e98f730 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:44.018229 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-a66c3e2b-d4a3-48f3-9ecf-30406e98f730 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:44.031033 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-a66c3e2b-d4a3-48f3-9ecf-30406e98f730 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1222 microversion: 2.1 time: 0.219403 Feb 08 16:41:44.039877 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 15/22] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:43 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1222 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:44.056371 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c96339eb-22ea-4cdd-8d04-806e40c15fe9 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde0db85e0>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:44.126139 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c96339eb-22ea-4cdd-8d04-806e40c15fe9 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938" status: 200 len: 287 microversion: 2.1 time: 0.084641 Feb 08 16:41:44.127550 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 16/23] 10.222.0.35 () {58 vars in 1250 bytes} [Tue Feb 8 16:41:44 2022] GET /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:41:44.134320 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-6f5d1cc8-7338-43b8-807f-909e46b48984 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:44.135140 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-6f5d1cc8-7338-43b8-807f-909e46b48984 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:44.144150 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6f5d1cc8-7338-43b8-807f-909e46b48984 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:44.144810 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6f5d1cc8-7338-43b8-807f-909e46b48984 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:44.145853 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6f5d1cc8-7338-43b8-807f-909e46b48984 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:44.147364 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6f5d1cc8-7338-43b8-807f-909e46b48984 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:44.769736 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-6f5d1cc8-7338-43b8-807f-909e46b48984 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:44.801771 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-6f5d1cc8-7338-43b8-807f-909e46b48984 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1275 microversion: 2.1 time: 0.670257 Feb 08 16:41:44.806458 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 17/24] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:44 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1275 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:44.825828 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-4122fd7b-9bbb-4ee9-8cf0-1d119f47dc12 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Getting quotas for project 2214758b43e6434b8c27d97f7fd1151c. Resources: {'key_pairs'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:41:44.831592 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-4122fd7b-9bbb-4ee9-8cf0-1d119f47dc12 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Getting quotas for user c5f36415ea7148d79f9fdb9cfac129e0 and project 2214758b43e6434b8c27d97f7fd1151c. Resources: {'key_pairs'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:41:44.859055 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-4122fd7b-9bbb-4ee9-8cf0-1d119f47dc12 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.763973 Feb 08 16:41:44.860130 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 8/25] 10.222.0.35 () {60 vars in 1157 bytes} [Tue Feb 8 16:41:43 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:45.053910 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-2e4db5d2-d6b5-4e74-af81-588fc82d2766 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:45.054828 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-2e4db5d2-d6b5-4e74-af81-588fc82d2766 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:45.071616 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2e4db5d2-d6b5-4e74-af81-588fc82d2766 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:45.073104 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2e4db5d2-d6b5-4e74-af81-588fc82d2766 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:45.074111 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2e4db5d2-d6b5-4e74-af81-588fc82d2766 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:45.075255 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2e4db5d2-d6b5-4e74-af81-588fc82d2766 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:45.145454 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-756c571f-b137-44b7-8823-cd7d6611664a tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde04faa60>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:45.243985 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-756c571f-b137-44b7-8823-cd7d6611664a tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938" status: 200 len: 287 microversion: 2.1 time: 0.108111 Feb 08 16:41:45.245252 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 9/26] 10.222.0.35 () {58 vars in 1250 bytes} [Tue Feb 8 16:41:45 2022] GET /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938 => generated 287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:41:45.468074 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-2e4db5d2-d6b5-4e74-af81-588fc82d2766 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:45.478568 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-2e4db5d2-d6b5-4e74-af81-588fc82d2766 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1226 microversion: 2.1 time: 0.430547 Feb 08 16:41:45.496317 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 18/27] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:45 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1226 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:45.822018 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d1613647-f2a0-48cb-801d-bb14f1880024 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:45.823085 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-d1613647-f2a0-48cb-801d-bb14f1880024 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:45.836286 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d1613647-f2a0-48cb-801d-bb14f1880024 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:45.843463 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d1613647-f2a0-48cb-801d-bb14f1880024 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:45.845859 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d1613647-f2a0-48cb-801d-bb14f1880024 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:45.848130 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d1613647-f2a0-48cb-801d-bb14f1880024 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:46.004266 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d1613647-f2a0-48cb-801d-bb14f1880024 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:46.030023 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d1613647-f2a0-48cb-801d-bb14f1880024 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1275 microversion: 2.1 time: 0.211830 Feb 08 16:41:46.031572 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 10/28] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:45 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1275 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:46.221664 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-486ad4ba-afda-43a9-b633-514534252705 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-966930220", "imageRef": "d70d3911-14f2-4cba-9283-bf4bef4fb526", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64dd4aa3-e414-467b-84ff-dc68d3d652e1"}], "security_groups": [{"name": "tempest-securitygroup--1451902308"}], "key_name": "tempest-keypair-181098442", "user_data": "}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:41:46.255791 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-49cfd3da-fda9-402a-81ab-a2a4c405de39 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde0d574c0>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:46.346733 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-49cfd3da-fda9-402a-81ab-a2a4c405de39 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938" status: 200 len: 287 microversion: 2.1 time: 0.095185 Feb 08 16:41:46.351553 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 11/29] 10.222.0.35 () {58 vars in 1250 bytes} [Tue Feb 8 16:41:46 2022] GET /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938 => generated 287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:41:46.502540 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-70788477-941c-47c3-920a-ff114c32724a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:46.503456 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-70788477-941c-47c3-920a-ff114c32724a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:46.518462 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-70788477-941c-47c3-920a-ff114c32724a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:46.520003 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-70788477-941c-47c3-920a-ff114c32724a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:46.532231 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-70788477-941c-47c3-920a-ff114c32724a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:46.534472 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-70788477-941c-47c3-920a-ff114c32724a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:46.887829 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.network.neutron [None req-486ad4ba-afda-43a9-b633-514534252705 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] validate_networks() for [('64dd4aa3-e414-467b-84ff-dc68d3d652e1', None, None, None, None, None)] {{(pid=122902) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 16:41:46.900377 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-70788477-941c-47c3-920a-ff114c32724a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:46.948527 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-70788477-941c-47c3-920a-ff114c32724a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1218 microversion: 2.1 time: 0.446642 Feb 08 16:41:46.949968 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 12/30] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:46 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1218 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:41:47.047861 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-16b5085f-f91b-478a-a4fb-d30387acc26d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:47.048765 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-16b5085f-f91b-478a-a4fb-d30387acc26d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:47.060939 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-16b5085f-f91b-478a-a4fb-d30387acc26d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:47.061995 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-16b5085f-f91b-478a-a4fb-d30387acc26d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:47.064743 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-16b5085f-f91b-478a-a4fb-d30387acc26d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:47.066699 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-16b5085f-f91b-478a-a4fb-d30387acc26d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:47.287689 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-16b5085f-f91b-478a-a4fb-d30387acc26d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:47.303984 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-16b5085f-f91b-478a-a4fb-d30387acc26d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1273 microversion: 2.1 time: 0.257982 Feb 08 16:41:47.306259 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 13/31] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:47 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1273 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:41:47.363834 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-db6a00b7-65e6-41df-a5b9-a33fe9f4d411 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde051a790>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:47.497967 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-db6a00b7-65e6-41df-a5b9-a33fe9f4d411 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938" status: 200 len: 287 microversion: 2.1 time: 0.142263 Feb 08 16:41:47.498697 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 14/32] 10.222.0.35 () {58 vars in 1250 bytes} [Tue Feb 8 16:41:47 2022] GET /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938 => generated 287 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:41:47.967695 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-358872a8-c3ad-4cb2-bb88-8431283cbc77 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:47.970865 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-358872a8-c3ad-4cb2-bb88-8431283cbc77 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:47.981836 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-358872a8-c3ad-4cb2-bb88-8431283cbc77 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:47.986614 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-358872a8-c3ad-4cb2-bb88-8431283cbc77 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:47.987515 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-358872a8-c3ad-4cb2-bb88-8431283cbc77 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:47.991644 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-358872a8-c3ad-4cb2-bb88-8431283cbc77 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:48.575659 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-358872a8-c3ad-4cb2-bb88-8431283cbc77 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:48.593261 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-358872a8-c3ad-4cb2-bb88-8431283cbc77 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1280 microversion: 2.1 time: 0.629834 Feb 08 16:41:48.593986 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 15/33] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:47 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1280 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:48.613715 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-8917af24-54ef-4a8e-87c8-c5506c3f33a8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:48.615164 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-8917af24-54ef-4a8e-87c8-c5506c3f33a8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:48.641595 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8917af24-54ef-4a8e-87c8-c5506c3f33a8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:48.647483 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8917af24-54ef-4a8e-87c8-c5506c3f33a8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:48.649514 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8917af24-54ef-4a8e-87c8-c5506c3f33a8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:48.651545 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8917af24-54ef-4a8e-87c8-c5506c3f33a8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:49.027861 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-8917af24-54ef-4a8e-87c8-c5506c3f33a8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:49.039038 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-8917af24-54ef-4a8e-87c8-c5506c3f33a8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1273 microversion: 2.1 time: 0.441463 Feb 08 16:41:49.052391 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 16/34] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:48 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1273 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:49.069873 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-be5056bf-15ea-4e79-a85b-280f0b0fa8b9 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde051a430>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:49.156409 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.wsgi [None req-be5056bf-15ea-4e79-a85b-280f0b0fa8b9 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] HTTP exception thrown: Snapshot 92303ddd-0b14-44c2-90a2-aafe239c4938 could not be found. Feb 08 16:41:49.157294 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-be5056bf-15ea-4e79-a85b-280f0b0fa8b9 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Returning 404 to user: Snapshot 92303ddd-0b14-44c2-90a2-aafe239c4938 could not be found. {{(pid=122901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:41:49.158574 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-be5056bf-15ea-4e79-a85b-280f0b0fa8b9 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938" status: 404 len: 111 microversion: 2.1 time: 0.104521 Feb 08 16:41:49.159295 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 17/35] 10.222.0.35 () {58 vars in 1250 bytes} [Tue Feb 8 16:41:49 2022] GET /compute/v2.1/os-snapshots/92303ddd-0b14-44c2-90a2-aafe239c4938 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:41:49.169537 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-f1afa640-90d1-44fb-9efc-4a4f22acab0f tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde22c70d0>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:49.358103 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-486ad4ba-afda-43a9-b633-514534252705 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Flavor limits 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 16:41:49.359508 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-486ad4ba-afda-43a9-b633-514534252705 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Image limits 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 16:41:49.360297 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-486ad4ba-afda-43a9-b633-514534252705 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Flavor pref 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 16:41:49.360986 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-486ad4ba-afda-43a9-b633-514534252705 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Image pref 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 16:41:49.361711 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-486ad4ba-afda-43a9-b633-514534252705 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 16:41:49.393305 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-486ad4ba-afda-43a9-b633-514534252705 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:49.401127 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-486ad4ba-afda-43a9-b633-514534252705 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:49.403015 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-f1afa640-90d1-44fb-9efc-4a4f22acab0f tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e" status: 202 len: 0 microversion: 2.1 time: 0.238509 Feb 08 16:41:49.407601 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 18/36] 10.222.0.35 () {58 vars in 1247 bytes} [Tue Feb 8 16:41:49 2022] DELETE /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 08 16:41:49.408502 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-486ad4ba-afda-43a9-b633-514534252705 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:49.409517 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-486ad4ba-afda-43a9-b633-514534252705 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:49.414884 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ab9c72e5-1bd5-4907-8495-75ef9921382d tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde051a160>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:49.461096 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-486ad4ba-afda-43a9-b633-514534252705 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Getting quotas for project 23325df6a88748fc9261e22c093ac67e. Resources: {'cores', 'ram', 'instances'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:41:49.468813 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-486ad4ba-afda-43a9-b633-514534252705 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Getting quotas for user c858d129681846aba9e366c37c2213a0 and project 23325df6a88748fc9261e22c093ac67e. Resources: {'cores', 'ram', 'instances'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:41:49.500138 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-486ad4ba-afda-43a9-b633-514534252705 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Going to run 1 instances... {{(pid=122902) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 16:41:49.502432 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-486ad4ba-afda-43a9-b633-514534252705 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d70d3911-14f2-4cba-9283-bf4bef4fb526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 16:41:49.534914 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-ab9c72e5-1bd5-4907-8495-75ef9921382d tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e" status: 200 len: 344 microversion: 2.1 time: 0.124834 Feb 08 16:41:49.540073 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 19/37] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Feb 8 16:41:49 2022] GET /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e => generated 344 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:41:49.540992 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-7549b824-dea0-499c-b91e-ee6c56da1b8f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1035389672", "imageRef": "d70d3911-14f2-4cba-9283-bf4bef4fb526", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ae536f5-aefa-4f5b-af4d-8517e1f813dd"}], "security_groups": [{"name": "tempest-securitygroup--491717241"}], "key_name": "tempest-keypair-701831441", "user_data": "}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:41:49.681975 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-486ad4ba-afda-43a9-b633-514534252705 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.464793 Feb 08 16:41:49.688416 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 19/38] 10.222.0.35 () {62 vars in 1187 bytes} [Tue Feb 8 16:41:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 3472 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 08 16:41:49.694829 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-1bef114e-9b97-4c6d-8aaa-abee8d447740 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:49.695788 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-1bef114e-9b97-4c6d-8aaa-abee8d447740 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:49.703299 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1bef114e-9b97-4c6d-8aaa-abee8d447740 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:49.704240 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1bef114e-9b97-4c6d-8aaa-abee8d447740 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:49.706815 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1bef114e-9b97-4c6d-8aaa-abee8d447740 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:49.707601 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1bef114e-9b97-4c6d-8aaa-abee8d447740 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:49.811419 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.network.neutron [None req-7549b824-dea0-499c-b91e-ee6c56da1b8f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] validate_networks() for [('7ae536f5-aefa-4f5b-af4d-8517e1f813dd', None, None, None, None, None)] {{(pid=122901) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 16:41:50.031653 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-1bef114e-9b97-4c6d-8aaa-abee8d447740 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:50.058074 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-1bef114e-9b97-4c6d-8aaa-abee8d447740 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1280 microversion: 2.1 time: 0.366064 Feb 08 16:41:50.059063 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 20/39] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:49 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1280 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:50.085443 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c21e0fb0-eb90-444b-aaef-9be0cf27c000 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:50.091889 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c21e0fb0-eb90-444b-aaef-9be0cf27c000 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:50.298764 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c21e0fb0-eb90-444b-aaef-9be0cf27c000 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:50.314350 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c21e0fb0-eb90-444b-aaef-9be0cf27c000 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:50.316956 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c21e0fb0-eb90-444b-aaef-9be0cf27c000 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:50.318743 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c21e0fb0-eb90-444b-aaef-9be0cf27c000 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1280 microversion: 2.20 time: 0.257854 Feb 08 16:41:50.319310 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 21/40] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:41:50 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1280 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:41:50.338299 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-f101fee2-da31-4c4e-8498-abdede682df2 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:50.338919 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-f101fee2-da31-4c4e-8498-abdede682df2 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:50.347785 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f101fee2-da31-4c4e-8498-abdede682df2 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:50.349591 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f101fee2-da31-4c4e-8498-abdede682df2 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:50.351096 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f101fee2-da31-4c4e-8498-abdede682df2 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:50.352728 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f101fee2-da31-4c4e-8498-abdede682df2 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:50.733429 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-f101fee2-da31-4c4e-8498-abdede682df2 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:50.750955 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-f101fee2-da31-4c4e-8498-abdede682df2 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1273 microversion: 2.1 time: 0.416319 Feb 08 16:41:50.755454 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 22/41] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:50 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1273 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:50.778774 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-104ddb0b-47ea-4411-9a69-c5a504cc6933 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde0cf81f0>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:50.884331 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-104ddb0b-47ea-4411-9a69-c5a504cc6933 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e" status: 200 len: 344 microversion: 2.1 time: 0.122201 Feb 08 16:41:50.885403 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 23/42] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Feb 8 16:41:50 2022] GET /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e => generated 344 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:41:51.075228 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-56f76310-8016-4019-8990-52a2e848102e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:51.076298 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-56f76310-8016-4019-8990-52a2e848102e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:51.086537 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-56f76310-8016-4019-8990-52a2e848102e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:51.087283 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-56f76310-8016-4019-8990-52a2e848102e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:51.088139 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-56f76310-8016-4019-8990-52a2e848102e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:51.088779 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-56f76310-8016-4019-8990-52a2e848102e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:51.261095 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-7549b824-dea0-499c-b91e-ee6c56da1b8f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Flavor limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 16:41:51.261601 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-7549b824-dea0-499c-b91e-ee6c56da1b8f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Image limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 16:41:51.262020 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-7549b824-dea0-499c-b91e-ee6c56da1b8f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Flavor pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 16:41:51.262439 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-7549b824-dea0-499c-b91e-ee6c56da1b8f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Image pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 16:41:51.262857 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-7549b824-dea0-499c-b91e-ee6c56da1b8f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 16:41:51.278682 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7549b824-dea0-499c-b91e-ee6c56da1b8f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:51.279341 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7549b824-dea0-499c-b91e-ee6c56da1b8f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:51.280284 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7549b824-dea0-499c-b91e-ee6c56da1b8f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:51.281095 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7549b824-dea0-499c-b91e-ee6c56da1b8f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:51.320211 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-7549b824-dea0-499c-b91e-ee6c56da1b8f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Getting quotas for project 2214758b43e6434b8c27d97f7fd1151c. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:41:51.324436 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-7549b824-dea0-499c-b91e-ee6c56da1b8f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Getting quotas for user c5f36415ea7148d79f9fdb9cfac129e0 and project 2214758b43e6434b8c27d97f7fd1151c. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:41:51.338988 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7549b824-dea0-499c-b91e-ee6c56da1b8f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Going to run 1 instances... {{(pid=122901) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 16:41:51.341776 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7549b824-dea0-499c-b91e-ee6c56da1b8f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d70d3911-14f2-4cba-9283-bf4bef4fb526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122901) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 16:41:51.392052 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-7549b824-dea0-499c-b91e-ee6c56da1b8f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.854471 Feb 08 16:41:51.398228 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 20/43] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Feb 8 16:41:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 1861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 16:41:51.404808 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-815627ee-6dac-406d-85cf-7558eb720db4 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:51.405579 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-815627ee-6dac-406d-85cf-7558eb720db4 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:51.415106 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-815627ee-6dac-406d-85cf-7558eb720db4 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:51.415883 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-815627ee-6dac-406d-85cf-7558eb720db4 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:51.416929 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-815627ee-6dac-406d-85cf-7558eb720db4 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:51.417804 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-815627ee-6dac-406d-85cf-7558eb720db4 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:51.505354 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-56f76310-8016-4019-8990-52a2e848102e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:51.522778 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-815627ee-6dac-406d-85cf-7558eb720db4 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:51.532772 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-56f76310-8016-4019-8990-52a2e848102e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.461504 Feb 08 16:41:51.534986 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 24/44] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:51 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:51.538576 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-815627ee-6dac-406d-85cf-7558eb720db4 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:51.540209 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-815627ee-6dac-406d-85cf-7558eb720db4 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:51.541595 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-815627ee-6dac-406d-85cf-7558eb720db4 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1284 microversion: 2.20 time: 0.142320 Feb 08 16:41:51.542451 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 21/45] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:41:51 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:41:51.569680 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-2b7202ff-9ca0-426a-93a7-a7a08c74aa53 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:51.570323 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-2b7202ff-9ca0-426a-93a7-a7a08c74aa53 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:51.668228 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-2b7202ff-9ca0-426a-93a7-a7a08c74aa53 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:51.691947 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-2b7202ff-9ca0-426a-93a7-a7a08c74aa53 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1237 microversion: 2.1 time: 0.142692 Feb 08 16:41:51.695794 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 25/46] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:51 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1237 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:51.784898 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-9801a7c5-95d1-4059-b6b0-d16f0704363e tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:51.786530 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-9801a7c5-95d1-4059-b6b0-d16f0704363e tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:51.802462 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9801a7c5-95d1-4059-b6b0-d16f0704363e tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:51.803717 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9801a7c5-95d1-4059-b6b0-d16f0704363e tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:51.806642 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9801a7c5-95d1-4059-b6b0-d16f0704363e tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:51.807115 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9801a7c5-95d1-4059-b6b0-d16f0704363e tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:51.898616 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-423f0c51-cfbf-493b-bf33-1cfd6988748f tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde0da15e0>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:51.985775 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-423f0c51-cfbf-493b-bf33-1cfd6988748f tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e" status: 200 len: 344 microversion: 2.1 time: 0.083843 Feb 08 16:41:51.986673 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 26/47] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Feb 8 16:41:51 2022] GET /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e => generated 344 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:41:52.225654 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-9801a7c5-95d1-4059-b6b0-d16f0704363e tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:52.237118 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-9801a7c5-95d1-4059-b6b0-d16f0704363e tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.462813 Feb 08 16:41:52.238197 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 22/48] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:51 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:52.550979 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-411b54cb-6b80-4af0-829a-40d308fa8de5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:52.552492 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-411b54cb-6b80-4af0-829a-40d308fa8de5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:52.561088 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-411b54cb-6b80-4af0-829a-40d308fa8de5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:52.561728 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-411b54cb-6b80-4af0-829a-40d308fa8de5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:52.562520 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-411b54cb-6b80-4af0-829a-40d308fa8de5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:52.562960 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-411b54cb-6b80-4af0-829a-40d308fa8de5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:52.564298 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-0d12e287-4a29-46d4-a295-f8e7d064e722 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:52.564939 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-0d12e287-4a29-46d4-a295-f8e7d064e722 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:52.576209 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0d12e287-4a29-46d4-a295-f8e7d064e722 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:52.576209 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0d12e287-4a29-46d4-a295-f8e7d064e722 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:52.576663 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0d12e287-4a29-46d4-a295-f8e7d064e722 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:52.577342 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0d12e287-4a29-46d4-a295-f8e7d064e722 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:52.658936 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0d12e287-4a29-46d4-a295-f8e7d064e722 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:52.667877 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0d12e287-4a29-46d4-a295-f8e7d064e722 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:52.669413 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0d12e287-4a29-46d4-a295-f8e7d064e722 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:52.670524 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-0d12e287-4a29-46d4-a295-f8e7d064e722 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1284 microversion: 2.20 time: 0.110909 Feb 08 16:41:52.671116 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 23/49] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:41:52 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:41:52.711438 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-89bea656-edc4-449d-abaa-8b760d831ce3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:52.712093 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-89bea656-edc4-449d-abaa-8b760d831ce3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:52.718408 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-89bea656-edc4-449d-abaa-8b760d831ce3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:52.719240 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-89bea656-edc4-449d-abaa-8b760d831ce3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:52.720283 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-89bea656-edc4-449d-abaa-8b760d831ce3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:52.721084 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-89bea656-edc4-449d-abaa-8b760d831ce3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:52.727449 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-411b54cb-6b80-4af0-829a-40d308fa8de5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:52.735389 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-411b54cb-6b80-4af0-829a-40d308fa8de5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.188720 Feb 08 16:41:52.736401 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 27/50] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:52 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:52.785918 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-89bea656-edc4-449d-abaa-8b760d831ce3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:52.793488 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-89bea656-edc4-449d-abaa-8b760d831ce3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1241 microversion: 2.1 time: 0.086717 Feb 08 16:41:52.794101 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 24/51] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:52 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:52.999007 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b79c2cf3-cd2f-4516-beb0-3620ce1ddf4e tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde1efbdc0>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:53.072031 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b79c2cf3-cd2f-4516-beb0-3620ce1ddf4e tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e" status: 200 len: 344 microversion: 2.1 time: 0.076528 Feb 08 16:41:53.078143 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 28/52] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Feb 8 16:41:52 2022] GET /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e => generated 344 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:41:53.255666 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-5aa2faf6-47c6-46da-b266-1669f53a2b18 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:53.257078 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-5aa2faf6-47c6-46da-b266-1669f53a2b18 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:53.264904 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5aa2faf6-47c6-46da-b266-1669f53a2b18 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:53.265570 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5aa2faf6-47c6-46da-b266-1669f53a2b18 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:53.266571 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5aa2faf6-47c6-46da-b266-1669f53a2b18 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:53.267306 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5aa2faf6-47c6-46da-b266-1669f53a2b18 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:53.409911 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-5aa2faf6-47c6-46da-b266-1669f53a2b18 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:53.418446 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-5aa2faf6-47c6-46da-b266-1669f53a2b18 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.167454 Feb 08 16:41:53.419024 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 25/53] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:53 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:53.688419 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-726203fb-0139-4262-9830-25720aa659d9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:53.689002 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-726203fb-0139-4262-9830-25720aa659d9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:53.696145 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-726203fb-0139-4262-9830-25720aa659d9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:53.696574 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-726203fb-0139-4262-9830-25720aa659d9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:53.697499 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-726203fb-0139-4262-9830-25720aa659d9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:53.698147 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-726203fb-0139-4262-9830-25720aa659d9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:53.752551 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-5e58564b-dc20-4ad3-bc08-7620bceb3a59 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:53.753162 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-5e58564b-dc20-4ad3-bc08-7620bceb3a59 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:53.759983 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5e58564b-dc20-4ad3-bc08-7620bceb3a59 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:53.760462 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5e58564b-dc20-4ad3-bc08-7620bceb3a59 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:53.761419 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5e58564b-dc20-4ad3-bc08-7620bceb3a59 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:53.762000 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5e58564b-dc20-4ad3-bc08-7620bceb3a59 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:53.769803 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-726203fb-0139-4262-9830-25720aa659d9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:53.778770 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-726203fb-0139-4262-9830-25720aa659d9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:53.781205 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-726203fb-0139-4262-9830-25720aa659d9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:53.782943 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-726203fb-0139-4262-9830-25720aa659d9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1284 microversion: 2.20 time: 0.098347 Feb 08 16:41:53.792452 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 29/54] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:41:53 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:41:53.824661 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-783a3da6-2f42-415d-834b-5e904b270143 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:53.827343 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-783a3da6-2f42-415d-834b-5e904b270143 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:53.841857 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-783a3da6-2f42-415d-834b-5e904b270143 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:53.842334 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-783a3da6-2f42-415d-834b-5e904b270143 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:53.845116 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-783a3da6-2f42-415d-834b-5e904b270143 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:53.845572 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-783a3da6-2f42-415d-834b-5e904b270143 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:53.947848 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-783a3da6-2f42-415d-834b-5e904b270143 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:53.950953 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-5e58564b-dc20-4ad3-bc08-7620bceb3a59 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:53.956767 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-783a3da6-2f42-415d-834b-5e904b270143 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1241 microversion: 2.1 time: 0.146896 Feb 08 16:41:53.957750 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 30/55] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:53 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1241 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:53.968794 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-5e58564b-dc20-4ad3-bc08-7620bceb3a59 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.219757 Feb 08 16:41:53.970988 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 26/56] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:53 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:41:54.085715 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-3c79f592-0737-489e-9aae-53f92cd01682 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde0da13a0>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:54.135651 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-3c79f592-0737-489e-9aae-53f92cd01682 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e" status: 200 len: 344 microversion: 2.1 time: 0.053976 Feb 08 16:41:54.136546 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 31/57] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Feb 8 16:41:54 2022] GET /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:41:54.434598 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-09961317-f76a-46ae-a35d-7045590f4d3a tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:54.435245 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-09961317-f76a-46ae-a35d-7045590f4d3a tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:54.440854 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-09961317-f76a-46ae-a35d-7045590f4d3a tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:54.441302 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-09961317-f76a-46ae-a35d-7045590f4d3a tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:54.442069 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-09961317-f76a-46ae-a35d-7045590f4d3a tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:54.442503 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-09961317-f76a-46ae-a35d-7045590f4d3a tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:54.579521 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-09961317-f76a-46ae-a35d-7045590f4d3a tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:54.587554 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-09961317-f76a-46ae-a35d-7045590f4d3a tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.156366 Feb 08 16:41:54.588435 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 27/58] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:54 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:54.802358 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-1ebe3c19-805f-41b2-b717-295f99cae609 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:54.803284 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-1ebe3c19-805f-41b2-b717-295f99cae609 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:54.811711 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1ebe3c19-805f-41b2-b717-295f99cae609 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:54.812188 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1ebe3c19-805f-41b2-b717-295f99cae609 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:54.813024 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1ebe3c19-805f-41b2-b717-295f99cae609 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:54.813463 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1ebe3c19-805f-41b2-b717-295f99cae609 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:54.876446 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-1ebe3c19-805f-41b2-b717-295f99cae609 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:54.885909 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-1ebe3c19-805f-41b2-b717-295f99cae609 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:54.887478 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-1ebe3c19-805f-41b2-b717-295f99cae609 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:54.888736 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-1ebe3c19-805f-41b2-b717-295f99cae609 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1284 microversion: 2.20 time: 0.090570 Feb 08 16:41:54.889307 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 32/59] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:41:54 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:41:54.974340 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-919346d0-de64-4fbc-865b-7166a1162953 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:54.974935 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-919346d0-de64-4fbc-865b-7166a1162953 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:54.981028 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-919346d0-de64-4fbc-865b-7166a1162953 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:54.981478 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-919346d0-de64-4fbc-865b-7166a1162953 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:54.982253 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-919346d0-de64-4fbc-865b-7166a1162953 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:54.982692 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-919346d0-de64-4fbc-865b-7166a1162953 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:54.985766 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-dbcc6f58-afc6-4679-bc36-212128b0382c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:54.986380 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-dbcc6f58-afc6-4679-bc36-212128b0382c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:54.992603 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dbcc6f58-afc6-4679-bc36-212128b0382c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:54.993056 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dbcc6f58-afc6-4679-bc36-212128b0382c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:54.994079 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dbcc6f58-afc6-4679-bc36-212128b0382c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:54.994523 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dbcc6f58-afc6-4679-bc36-212128b0382c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:55.072326 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-919346d0-de64-4fbc-865b-7166a1162953 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:55.081660 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-919346d0-de64-4fbc-865b-7166a1162953 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1241 microversion: 2.1 time: 0.111001 Feb 08 16:41:55.082844 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 28/60] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:54 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:55.148200 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-dbcc6f58-afc6-4679-bc36-212128b0382c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:55.148967 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d1d0bf60-d54c-4977-892c-15b7075d5f58 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde0508f70>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:55.156580 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-dbcc6f58-afc6-4679-bc36-212128b0382c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.174304 Feb 08 16:41:55.157315 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 33/61] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:54 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:41:55.201130 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d1d0bf60-d54c-4977-892c-15b7075d5f58 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e" status: 200 len: 344 microversion: 2.1 time: 0.056334 Feb 08 16:41:55.201719 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 29/62] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Feb 8 16:41:55 2022] GET /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:41:55.608162 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-42211dac-3d08-446a-aa92-129f7e5ebb97 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:55.609953 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-42211dac-3d08-446a-aa92-129f7e5ebb97 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:55.618913 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-42211dac-3d08-446a-aa92-129f7e5ebb97 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:55.619358 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-42211dac-3d08-446a-aa92-129f7e5ebb97 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:55.620630 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-42211dac-3d08-446a-aa92-129f7e5ebb97 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:55.621220 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-42211dac-3d08-446a-aa92-129f7e5ebb97 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:55.838888 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-42211dac-3d08-446a-aa92-129f7e5ebb97 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:55.847911 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-42211dac-3d08-446a-aa92-129f7e5ebb97 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.246210 Feb 08 16:41:55.859024 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 34/63] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:55 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:55.908488 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-a96a8d5a-7867-4abf-81bb-4740a275fa45 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:55.909561 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-a96a8d5a-7867-4abf-81bb-4740a275fa45 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:55.917015 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a96a8d5a-7867-4abf-81bb-4740a275fa45 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:55.918558 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a96a8d5a-7867-4abf-81bb-4740a275fa45 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:55.919335 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a96a8d5a-7867-4abf-81bb-4740a275fa45 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:55.919878 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a96a8d5a-7867-4abf-81bb-4740a275fa45 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:55.999745 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-a96a8d5a-7867-4abf-81bb-4740a275fa45 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:56.011124 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-a96a8d5a-7867-4abf-81bb-4740a275fa45 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:56.012673 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-a96a8d5a-7867-4abf-81bb-4740a275fa45 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:56.013924 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-a96a8d5a-7867-4abf-81bb-4740a275fa45 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1284 microversion: 2.20 time: 0.110974 Feb 08 16:41:56.014751 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 30/64] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:41:55 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:41:56.099931 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-df04e97e-7d3f-49a2-9334-8652846f6394 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:56.100313 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-df04e97e-7d3f-49a2-9334-8652846f6394 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:56.125714 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-df04e97e-7d3f-49a2-9334-8652846f6394 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:56.130443 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-df04e97e-7d3f-49a2-9334-8652846f6394 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:56.131986 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-df04e97e-7d3f-49a2-9334-8652846f6394 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:56.132636 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-df04e97e-7d3f-49a2-9334-8652846f6394 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:56.184039 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-1507afd0-b440-419c-9695-7cc4d4cbd985 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:56.184921 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-1507afd0-b440-419c-9695-7cc4d4cbd985 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:56.192554 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1507afd0-b440-419c-9695-7cc4d4cbd985 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:56.193581 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1507afd0-b440-419c-9695-7cc4d4cbd985 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:56.194563 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1507afd0-b440-419c-9695-7cc4d4cbd985 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:56.197282 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1507afd0-b440-419c-9695-7cc4d4cbd985 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:56.244416 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-df04e97e-7d3f-49a2-9334-8652846f6394 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:56.254591 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-df04e97e-7d3f-49a2-9334-8652846f6394 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1241 microversion: 2.1 time: 0.157790 Feb 08 16:41:56.265779 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 35/65] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:56 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1241 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:56.272214 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-f7a4023f-f726-4afc-9304-975a96988fe7 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde0d4fee0>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:56.373611 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-f7a4023f-f726-4afc-9304-975a96988fe7 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] HTTP exception thrown: Volume 7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e could not be found. Feb 08 16:41:56.374254 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-f7a4023f-f726-4afc-9304-975a96988fe7 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Returning 404 to user: Volume 7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e could not be found. {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:41:56.375651 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-f7a4023f-f726-4afc-9304-975a96988fe7 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e" status: 404 len: 109 microversion: 2.1 time: 0.108566 Feb 08 16:41:56.376693 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 36/66] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Feb 8 16:41:56 2022] GET /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:41:56.403437 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b523086d-4a01-49b2-93c2-ef02a1b5fc11 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde275e430>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:56.444161 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-1507afd0-b440-419c-9695-7cc4d4cbd985 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:56.460774 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-1507afd0-b440-419c-9695-7cc4d4cbd985 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.280573 Feb 08 16:41:56.468124 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 31/67] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:56 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:56.551300 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-b523086d-4a01-49b2-93c2-ef02a1b5fc11 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] HTTP exception thrown: Volume 7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e could not be found. Feb 08 16:41:56.552480 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b523086d-4a01-49b2-93c2-ef02a1b5fc11 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Returning 404 to user: Volume 7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e could not be found. {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:41:56.553670 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b523086d-4a01-49b2-93c2-ef02a1b5fc11 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e" status: 404 len: 109 microversion: 2.1 time: 0.165599 Feb 08 16:41:56.554864 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 37/68] 10.222.0.35 () {58 vars in 1247 bytes} [Tue Feb 8 16:41:56 2022] DELETE /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e => generated 109 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:41:56.562410 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-128473da-a052-40eb-abc3-3407a349c383 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Calling method '.version_select at 0x7fcde2253a60>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:56.695156 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.wsgi [None req-128473da-a052-40eb-abc3-3407a349c383 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] HTTP exception thrown: Volume 7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e could not be found. Feb 08 16:41:56.695818 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-128473da-a052-40eb-abc3-3407a349c383 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] Returning 404 to user: Volume 7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e could not be found. {{(pid=122901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:41:56.696722 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-128473da-a052-40eb-abc3-3407a349c383 tempest-VolumesSnapshotsTestJSON-1211392941 tempest-VolumesSnapshotsTestJSON-1211392941-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e" status: 404 len: 109 microversion: 2.1 time: 0.137869 Feb 08 16:41:56.700391 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 32/69] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Feb 8 16:41:56 2022] GET /compute/v2.1/os-volumes/7ac8d78b-0f22-4cc4-bfb6-ffbd0b55d52e => generated 109 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:41:56.869695 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-affacfc9-9dbc-4d97-8ec1-8b82b832a429 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:56.870702 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-affacfc9-9dbc-4d97-8ec1-8b82b832a429 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:56.877643 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-affacfc9-9dbc-4d97-8ec1-8b82b832a429 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:56.878266 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-affacfc9-9dbc-4d97-8ec1-8b82b832a429 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:56.879179 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-affacfc9-9dbc-4d97-8ec1-8b82b832a429 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:56.880747 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-affacfc9-9dbc-4d97-8ec1-8b82b832a429 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:57.016096 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-affacfc9-9dbc-4d97-8ec1-8b82b832a429 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:57.023978 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-affacfc9-9dbc-4d97-8ec1-8b82b832a429 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.161188 Feb 08 16:41:57.024637 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 38/70] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:56 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:57.037994 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-4909d135-8f76-48a8-8b4b-e40fd9616486 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:57.038533 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4909d135-8f76-48a8-8b4b-e40fd9616486 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:57.045310 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4909d135-8f76-48a8-8b4b-e40fd9616486 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:57.045997 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4909d135-8f76-48a8-8b4b-e40fd9616486 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:57.046953 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4909d135-8f76-48a8-8b4b-e40fd9616486 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:57.047468 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4909d135-8f76-48a8-8b4b-e40fd9616486 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:57.129027 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4909d135-8f76-48a8-8b4b-e40fd9616486 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:57.138755 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4909d135-8f76-48a8-8b4b-e40fd9616486 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:57.140732 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4909d135-8f76-48a8-8b4b-e40fd9616486 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:57.142189 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-4909d135-8f76-48a8-8b4b-e40fd9616486 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1284 microversion: 2.20 time: 0.107816 Feb 08 16:41:57.142915 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 33/71] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:41:57 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:41:57.275213 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b7b578bb-c187-450d-a791-0949d4e9c8af tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:57.275213 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b7b578bb-c187-450d-a791-0949d4e9c8af tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:57.279439 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b7b578bb-c187-450d-a791-0949d4e9c8af tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:57.279913 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b7b578bb-c187-450d-a791-0949d4e9c8af tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:57.280713 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b7b578bb-c187-450d-a791-0949d4e9c8af tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:57.281156 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b7b578bb-c187-450d-a791-0949d4e9c8af tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:57.487502 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e0614bd0-c9e1-4c42-b1a4-a216a989405e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:57.488322 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e0614bd0-c9e1-4c42-b1a4-a216a989405e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:57.498056 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e0614bd0-c9e1-4c42-b1a4-a216a989405e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:57.498951 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e0614bd0-c9e1-4c42-b1a4-a216a989405e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:57.499942 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e0614bd0-c9e1-4c42-b1a4-a216a989405e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:57.500539 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e0614bd0-c9e1-4c42-b1a4-a216a989405e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:57.501798 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b7b578bb-c187-450d-a791-0949d4e9c8af tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:57.512026 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b7b578bb-c187-450d-a791-0949d4e9c8af tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1241 microversion: 2.1 time: 0.243345 Feb 08 16:41:57.513285 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 39/72] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:57 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1241 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:57.703066 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e0614bd0-c9e1-4c42-b1a4-a216a989405e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:57.711775 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e0614bd0-c9e1-4c42-b1a4-a216a989405e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.227994 Feb 08 16:41:57.713246 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 34/73] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:57 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:41:58.040282 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-ed3f7f7c-99d8-482e-a0c1-e3bfe2e38b2b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:58.040912 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-ed3f7f7c-99d8-482e-a0c1-e3bfe2e38b2b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:58.047379 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ed3f7f7c-99d8-482e-a0c1-e3bfe2e38b2b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:58.054061 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ed3f7f7c-99d8-482e-a0c1-e3bfe2e38b2b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:58.054061 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ed3f7f7c-99d8-482e-a0c1-e3bfe2e38b2b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:58.054061 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ed3f7f7c-99d8-482e-a0c1-e3bfe2e38b2b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:58.163164 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d9bf1417-fbed-4481-acc0-4157d15a2b2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:58.164176 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-d9bf1417-fbed-4481-acc0-4157d15a2b2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:58.170714 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d9bf1417-fbed-4481-acc0-4157d15a2b2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:58.171228 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d9bf1417-fbed-4481-acc0-4157d15a2b2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:58.172165 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d9bf1417-fbed-4481-acc0-4157d15a2b2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:58.172678 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d9bf1417-fbed-4481-acc0-4157d15a2b2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:58.190744 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ed3f7f7c-99d8-482e-a0c1-e3bfe2e38b2b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:58.199168 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-ed3f7f7c-99d8-482e-a0c1-e3bfe2e38b2b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.163177 Feb 08 16:41:58.199955 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 40/74] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:58 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:58.240750 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d9bf1417-fbed-4481-acc0-4157d15a2b2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:58.248868 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d9bf1417-fbed-4481-acc0-4157d15a2b2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:58.250495 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d9bf1417-fbed-4481-acc0-4157d15a2b2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:58.251709 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d9bf1417-fbed-4481-acc0-4157d15a2b2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1284 microversion: 2.20 time: 0.093819 Feb 08 16:41:58.252371 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 35/75] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:41:58 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:41:58.531072 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-504d723c-da4a-48c4-b3f5-b984336f8f8d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:58.531727 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-504d723c-da4a-48c4-b3f5-b984336f8f8d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:58.538429 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-504d723c-da4a-48c4-b3f5-b984336f8f8d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:58.538880 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-504d723c-da4a-48c4-b3f5-b984336f8f8d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:58.539654 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-504d723c-da4a-48c4-b3f5-b984336f8f8d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:58.540118 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-504d723c-da4a-48c4-b3f5-b984336f8f8d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:58.601212 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-504d723c-da4a-48c4-b3f5-b984336f8f8d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:58.608946 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-504d723c-da4a-48c4-b3f5-b984336f8f8d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1241 microversion: 2.1 time: 0.081492 Feb 08 16:41:58.609507 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 41/76] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:58 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:58.728485 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-895e9396-7b80-4121-a5b7-a59180ec52bf tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:58.729363 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-895e9396-7b80-4121-a5b7-a59180ec52bf tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:58.735066 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-895e9396-7b80-4121-a5b7-a59180ec52bf tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:58.735508 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-895e9396-7b80-4121-a5b7-a59180ec52bf tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:58.736307 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-895e9396-7b80-4121-a5b7-a59180ec52bf tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:58.736737 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-895e9396-7b80-4121-a5b7-a59180ec52bf tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:58.874805 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-895e9396-7b80-4121-a5b7-a59180ec52bf tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:58.884682 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-895e9396-7b80-4121-a5b7-a59180ec52bf tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.158222 Feb 08 16:41:58.890222 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 36/77] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:58 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:41:59.216485 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-dd2cf8af-3983-4448-a995-d91c7fb2c712 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:59.217092 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-dd2cf8af-3983-4448-a995-d91c7fb2c712 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:59.223052 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dd2cf8af-3983-4448-a995-d91c7fb2c712 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:59.224111 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dd2cf8af-3983-4448-a995-d91c7fb2c712 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:59.224930 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dd2cf8af-3983-4448-a995-d91c7fb2c712 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:59.225369 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dd2cf8af-3983-4448-a995-d91c7fb2c712 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:59.271255 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e22b9619-2520-4eb6-a182-93ac7ae0f2bc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:59.271945 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e22b9619-2520-4eb6-a182-93ac7ae0f2bc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:59.279202 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e22b9619-2520-4eb6-a182-93ac7ae0f2bc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:59.279644 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e22b9619-2520-4eb6-a182-93ac7ae0f2bc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:59.280626 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e22b9619-2520-4eb6-a182-93ac7ae0f2bc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:59.281062 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e22b9619-2520-4eb6-a182-93ac7ae0f2bc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:59.362863 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e22b9619-2520-4eb6-a182-93ac7ae0f2bc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:59.371542 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e22b9619-2520-4eb6-a182-93ac7ae0f2bc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:59.373098 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e22b9619-2520-4eb6-a182-93ac7ae0f2bc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:59.374195 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e22b9619-2520-4eb6-a182-93ac7ae0f2bc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1284 microversion: 2.20 time: 0.107644 Feb 08 16:41:59.374747 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 37/78] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:41:59 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:41:59.392191 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-dd2cf8af-3983-4448-a995-d91c7fb2c712 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:59.400135 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-dd2cf8af-3983-4448-a995-d91c7fb2c712 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.187461 Feb 08 16:41:59.400695 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 42/79] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:59 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:59.626303 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-bc163a0d-4a70-40ed-a939-1c1a01b7d559 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:59.626820 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-bc163a0d-4a70-40ed-a939-1c1a01b7d559 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:59.634423 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bc163a0d-4a70-40ed-a939-1c1a01b7d559 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:59.634880 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bc163a0d-4a70-40ed-a939-1c1a01b7d559 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:59.635652 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bc163a0d-4a70-40ed-a939-1c1a01b7d559 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:59.636272 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bc163a0d-4a70-40ed-a939-1c1a01b7d559 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:59.698028 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-bc163a0d-4a70-40ed-a939-1c1a01b7d559 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:41:59.706051 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-bc163a0d-4a70-40ed-a939-1c1a01b7d559 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1241 microversion: 2.1 time: 0.084203 Feb 08 16:41:59.706637 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 38/80] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:59 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:41:59.901543 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-8950344c-2cf3-4adb-be67-ee48869ef06d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:41:59.902169 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-8950344c-2cf3-4adb-be67-ee48869ef06d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:41:59.908398 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8950344c-2cf3-4adb-be67-ee48869ef06d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:59.908842 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8950344c-2cf3-4adb-be67-ee48869ef06d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:41:59.909712 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8950344c-2cf3-4adb-be67-ee48869ef06d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:41:59.910441 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8950344c-2cf3-4adb-be67-ee48869ef06d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:00.088239 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-8950344c-2cf3-4adb-be67-ee48869ef06d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:00.096165 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-8950344c-2cf3-4adb-be67-ee48869ef06d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.198698 Feb 08 16:42:00.096781 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 43/81] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:41:59 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:00.398016 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-3893e2b9-767c-42d2-b173-448a8923d976 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:00.398812 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-3893e2b9-767c-42d2-b173-448a8923d976 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:00.404818 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3893e2b9-767c-42d2-b173-448a8923d976 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:00.405333 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3893e2b9-767c-42d2-b173-448a8923d976 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:00.406181 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3893e2b9-767c-42d2-b173-448a8923d976 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:00.406685 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3893e2b9-767c-42d2-b173-448a8923d976 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:00.419634 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b3173052-549e-467b-b831-81d40df298a0 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:00.420447 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b3173052-549e-467b-b831-81d40df298a0 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:00.433005 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b3173052-549e-467b-b831-81d40df298a0 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:00.433548 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b3173052-549e-467b-b831-81d40df298a0 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:00.434481 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b3173052-549e-467b-b831-81d40df298a0 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:00.435204 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b3173052-549e-467b-b831-81d40df298a0 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:00.476812 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-3893e2b9-767c-42d2-b173-448a8923d976 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:00.486966 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-3893e2b9-767c-42d2-b173-448a8923d976 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:00.488689 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-3893e2b9-767c-42d2-b173-448a8923d976 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:00.490022 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-3893e2b9-767c-42d2-b173-448a8923d976 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1284 microversion: 2.20 time: 0.103066 Feb 08 16:42:00.491613 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 39/82] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:00 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:00.586856 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b3173052-549e-467b-b831-81d40df298a0 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:00.594129 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b3173052-549e-467b-b831-81d40df298a0 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.181277 Feb 08 16:42:00.594693 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 44/83] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:00 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:42:00.723155 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-374ad77c-f023-4895-8fc5-50b4d97c9099 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:00.723773 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-374ad77c-f023-4895-8fc5-50b4d97c9099 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:00.730511 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-374ad77c-f023-4895-8fc5-50b4d97c9099 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:00.731000 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-374ad77c-f023-4895-8fc5-50b4d97c9099 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:00.731798 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-374ad77c-f023-4895-8fc5-50b4d97c9099 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:00.732241 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-374ad77c-f023-4895-8fc5-50b4d97c9099 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:00.790029 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-374ad77c-f023-4895-8fc5-50b4d97c9099 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:00.797476 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-374ad77c-f023-4895-8fc5-50b4d97c9099 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1241 microversion: 2.1 time: 0.077963 Feb 08 16:42:00.798050 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 40/84] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:00 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:01.113654 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-6d5cdf76-d52d-4c57-adc2-11885fbe5960 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:01.114515 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-6d5cdf76-d52d-4c57-adc2-11885fbe5960 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:01.120788 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6d5cdf76-d52d-4c57-adc2-11885fbe5960 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:01.121335 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6d5cdf76-d52d-4c57-adc2-11885fbe5960 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:01.122158 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6d5cdf76-d52d-4c57-adc2-11885fbe5960 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:01.122600 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6d5cdf76-d52d-4c57-adc2-11885fbe5960 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:01.250974 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-6d5cdf76-d52d-4c57-adc2-11885fbe5960 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:01.258440 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-6d5cdf76-d52d-4c57-adc2-11885fbe5960 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.148740 Feb 08 16:42:01.259008 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 45/85] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:01 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:01.508091 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-6aa00b45-5875-4c1b-8891-662c5858561c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:01.508601 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-6aa00b45-5875-4c1b-8891-662c5858561c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:01.514380 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6aa00b45-5875-4c1b-8891-662c5858561c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:01.514821 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6aa00b45-5875-4c1b-8891-662c5858561c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:01.515581 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6aa00b45-5875-4c1b-8891-662c5858561c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:01.516037 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6aa00b45-5875-4c1b-8891-662c5858561c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:01.574556 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-6aa00b45-5875-4c1b-8891-662c5858561c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:01.582200 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-6aa00b45-5875-4c1b-8891-662c5858561c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:01.583689 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-6aa00b45-5875-4c1b-8891-662c5858561c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:01.585433 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-6aa00b45-5875-4c1b-8891-662c5858561c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1284 microversion: 2.20 time: 0.080822 Feb 08 16:42:01.585991 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 41/86] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:01 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1284 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:01.614164 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b3bcf9fe-36b9-4b1e-bd8e-b0c54bfef8f4 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:01.614769 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b3bcf9fe-36b9-4b1e-bd8e-b0c54bfef8f4 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:01.620576 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b3bcf9fe-36b9-4b1e-bd8e-b0c54bfef8f4 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:01.621051 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b3bcf9fe-36b9-4b1e-bd8e-b0c54bfef8f4 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:01.622317 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b3bcf9fe-36b9-4b1e-bd8e-b0c54bfef8f4 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:01.622792 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b3bcf9fe-36b9-4b1e-bd8e-b0c54bfef8f4 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:01.758061 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b3bcf9fe-36b9-4b1e-bd8e-b0c54bfef8f4 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:01.765879 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b3bcf9fe-36b9-4b1e-bd8e-b0c54bfef8f4 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.158362 Feb 08 16:42:01.766417 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 46/87] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:01 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:01.814073 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-0a4776d8-c3a1-4e13-b2bc-0da1f229c8d6 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:01.814674 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-0a4776d8-c3a1-4e13-b2bc-0da1f229c8d6 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:01.820486 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0a4776d8-c3a1-4e13-b2bc-0da1f229c8d6 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:01.820927 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0a4776d8-c3a1-4e13-b2bc-0da1f229c8d6 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:01.821687 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0a4776d8-c3a1-4e13-b2bc-0da1f229c8d6 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:01.822111 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0a4776d8-c3a1-4e13-b2bc-0da1f229c8d6 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:01.881118 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0a4776d8-c3a1-4e13-b2bc-0da1f229c8d6 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:01.889134 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-0a4776d8-c3a1-4e13-b2bc-0da1f229c8d6 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1241 microversion: 2.1 time: 0.078601 Feb 08 16:42:01.889818 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 42/88] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:01 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:02.274886 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-13b71d03-24ca-47e1-be6c-c7a57750bf56 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:02.275492 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-13b71d03-24ca-47e1-be6c-c7a57750bf56 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:02.281546 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-13b71d03-24ca-47e1-be6c-c7a57750bf56 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:02.281996 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-13b71d03-24ca-47e1-be6c-c7a57750bf56 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:02.282769 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-13b71d03-24ca-47e1-be6c-c7a57750bf56 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:02.283202 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-13b71d03-24ca-47e1-be6c-c7a57750bf56 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:02.411679 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-13b71d03-24ca-47e1-be6c-c7a57750bf56 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:02.419591 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-13b71d03-24ca-47e1-be6c-c7a57750bf56 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.148335 Feb 08 16:42:02.420191 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 47/89] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:02 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:02.603060 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ecb2333a-ee82-41e8-90e0-7f2f94fa7b26 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:02.603680 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-ecb2333a-ee82-41e8-90e0-7f2f94fa7b26 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:02.610307 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ecb2333a-ee82-41e8-90e0-7f2f94fa7b26 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:02.610816 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ecb2333a-ee82-41e8-90e0-7f2f94fa7b26 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:02.611679 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ecb2333a-ee82-41e8-90e0-7f2f94fa7b26 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:02.612157 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ecb2333a-ee82-41e8-90e0-7f2f94fa7b26 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:02.703690 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ecb2333a-ee82-41e8-90e0-7f2f94fa7b26 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:02.714233 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ecb2333a-ee82-41e8-90e0-7f2f94fa7b26 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:02.715741 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ecb2333a-ee82-41e8-90e0-7f2f94fa7b26 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:02.718945 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-ecb2333a-ee82-41e8-90e0-7f2f94fa7b26 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1284 microversion: 2.20 time: 0.117970 Feb 08 16:42:02.732089 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 43/90] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:02 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:02.784273 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-4848bbc0-f84a-4cd7-8069-0c7fc70e9bc2 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:02.785729 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-4848bbc0-f84a-4cd7-8069-0c7fc70e9bc2 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:02.795082 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4848bbc0-f84a-4cd7-8069-0c7fc70e9bc2 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:02.796270 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4848bbc0-f84a-4cd7-8069-0c7fc70e9bc2 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:02.797823 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4848bbc0-f84a-4cd7-8069-0c7fc70e9bc2 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:02.798276 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4848bbc0-f84a-4cd7-8069-0c7fc70e9bc2 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:02.906990 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ce73e77a-6edf-4536-8409-2f9adbe2c5bc tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:02.909126 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-ce73e77a-6edf-4536-8409-2f9adbe2c5bc tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:02.917310 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ce73e77a-6edf-4536-8409-2f9adbe2c5bc tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:02.918713 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ce73e77a-6edf-4536-8409-2f9adbe2c5bc tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:02.920319 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ce73e77a-6edf-4536-8409-2f9adbe2c5bc tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:02.921225 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ce73e77a-6edf-4536-8409-2f9adbe2c5bc tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:03.055242 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ce73e77a-6edf-4536-8409-2f9adbe2c5bc tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:03.065828 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-ce73e77a-6edf-4536-8409-2f9adbe2c5bc tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1233 microversion: 2.1 time: 0.164165 Feb 08 16:42:03.069232 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 44/91] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:02 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1233 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:03.134887 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-4848bbc0-f84a-4cd7-8069-0c7fc70e9bc2 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:03.143662 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-4848bbc0-f84a-4cd7-8069-0c7fc70e9bc2 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.364858 Feb 08 16:42:03.144794 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 48/92] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:02 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:03.439540 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-44bc9d80-4996-43f2-8799-4b6037c89a1e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:03.440377 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-44bc9d80-4996-43f2-8799-4b6037c89a1e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:03.448846 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-44bc9d80-4996-43f2-8799-4b6037c89a1e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:03.449854 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-44bc9d80-4996-43f2-8799-4b6037c89a1e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:03.450864 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-44bc9d80-4996-43f2-8799-4b6037c89a1e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:03.451570 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-44bc9d80-4996-43f2-8799-4b6037c89a1e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:03.737400 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-6ce79e42-9914-4a5f-8626-7a7a0024d133 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:03.738001 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-6ce79e42-9914-4a5f-8626-7a7a0024d133 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:03.745367 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6ce79e42-9914-4a5f-8626-7a7a0024d133 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:03.745815 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6ce79e42-9914-4a5f-8626-7a7a0024d133 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:03.746598 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6ce79e42-9914-4a5f-8626-7a7a0024d133 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:03.747031 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6ce79e42-9914-4a5f-8626-7a7a0024d133 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:03.916746 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-6ce79e42-9914-4a5f-8626-7a7a0024d133 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:03.937572 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-6ce79e42-9914-4a5f-8626-7a7a0024d133 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:03.946439 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-6ce79e42-9914-4a5f-8626-7a7a0024d133 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:03.953868 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-6ce79e42-9914-4a5f-8626-7a7a0024d133 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1340 microversion: 2.20 time: 0.219574 Feb 08 16:42:03.958147 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 49/93] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:03 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1340 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:04.015677 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-44bc9d80-4996-43f2-8799-4b6037c89a1e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:04.028006 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-44bc9d80-4996-43f2-8799-4b6037c89a1e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.593968 Feb 08 16:42:04.029075 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 45/94] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:03 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:04.086163 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-8f0a3c1c-68d3-4ce9-b8d9-e9cb937e9490 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:04.087349 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-8f0a3c1c-68d3-4ce9-b8d9-e9cb937e9490 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:04.102506 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8f0a3c1c-68d3-4ce9-b8d9-e9cb937e9490 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:04.103206 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8f0a3c1c-68d3-4ce9-b8d9-e9cb937e9490 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:04.105166 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8f0a3c1c-68d3-4ce9-b8d9-e9cb937e9490 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:04.107647 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8f0a3c1c-68d3-4ce9-b8d9-e9cb937e9490 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:04.228651 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-3558815f-9175-4330-be66-d3d829a3853a req-36505586-c073-4743-8a5e-eade9854f0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46b82748-ebae-4771-b414-3feb285df38d", "tag": "c74e45fa-8736-4935-9ded-fac78de32cfe"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:42:04.232299 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:42:04.232299 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:42:04.274532 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-3558815f-9175-4330-be66-d3d829a3853a req-36505586-c073-4743-8a5e-eade9854f0f0 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:04.275060 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-3558815f-9175-4330-be66-d3d829a3853a req-36505586-c073-4743-8a5e-eade9854f0f0 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:04.330871 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-3558815f-9175-4330-be66-d3d829a3853a req-36505586-c073-4743-8a5e-eade9854f0f0 service nova] Creating event network-changed:c74e45fa-8736-4935-9ded-fac78de32cfe for instance 46b82748-ebae-4771-b414-3feb285df38d on hv-cinder-82786 Feb 08 16:42:04.332334 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-3558815f-9175-4330-be66-d3d829a3853a req-36505586-c073-4743-8a5e-eade9854f0f0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122902) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 08 16:42:04.337733 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-03090a1d-cedf-4746-9f52-1c33fed5d4d1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:04.338533 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-03090a1d-cedf-4746-9f52-1c33fed5d4d1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:04.339847 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-03090a1d-cedf-4746-9f52-1c33fed5d4d1 None None] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:04.340488 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-03090a1d-cedf-4746-9f52-1c33fed5d4d1 None None] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:04.356349 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.compute.rpcapi [None req-03090a1d-cedf-4746-9f52-1c33fed5d4d1 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Feb 08 16:42:04.357301 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-03090a1d-cedf-4746-9f52-1c33fed5d4d1 None None] Releasing lock "compute-rpcapi-router" {{(pid=122902) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 08 16:42:04.388351 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-03090a1d-cedf-4746-9f52-1c33fed5d4d1 None None] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.321759 Feb 08 16:42:04.390611 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 50/95] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:42:04.399095 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-536a9f3a-3c86-4bce-8474-c0de6b1f93ea tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:04.400208 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-536a9f3a-3c86-4bce-8474-c0de6b1f93ea tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:04.411127 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-536a9f3a-3c86-4bce-8474-c0de6b1f93ea tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:04.411796 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-536a9f3a-3c86-4bce-8474-c0de6b1f93ea tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:04.412859 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-536a9f3a-3c86-4bce-8474-c0de6b1f93ea tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:04.413577 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-536a9f3a-3c86-4bce-8474-c0de6b1f93ea tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:04.621045 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-8f0a3c1c-68d3-4ce9-b8d9-e9cb937e9490 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:04.633613 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-8f0a3c1c-68d3-4ce9-b8d9-e9cb937e9490 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1297 microversion: 2.1 time: 0.554620 Feb 08 16:42:04.635578 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 46/96] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:04 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1297 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:42:04.977902 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-da4546d5-0cc0-457e-ae75-02de10117d15 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:04.978761 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-da4546d5-0cc0-457e-ae75-02de10117d15 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:04.989040 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-da4546d5-0cc0-457e-ae75-02de10117d15 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:04.989796 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-da4546d5-0cc0-457e-ae75-02de10117d15 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:04.990913 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-da4546d5-0cc0-457e-ae75-02de10117d15 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:04.992425 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-da4546d5-0cc0-457e-ae75-02de10117d15 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:05.116799 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-da4546d5-0cc0-457e-ae75-02de10117d15 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:05.134407 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-da4546d5-0cc0-457e-ae75-02de10117d15 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:05.136419 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-da4546d5-0cc0-457e-ae75-02de10117d15 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:05.142164 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-da4546d5-0cc0-457e-ae75-02de10117d15 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1338 microversion: 2.20 time: 0.168987 Feb 08 16:42:05.155848 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 47/97] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:04 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1338 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:05.162938 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-0254843e-3cc9-4033-9333-8e9dafa105e5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:05.164239 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-0254843e-3cc9-4033-9333-8e9dafa105e5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:05.171993 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0254843e-3cc9-4033-9333-8e9dafa105e5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:05.172721 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0254843e-3cc9-4033-9333-8e9dafa105e5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:05.173741 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0254843e-3cc9-4033-9333-8e9dafa105e5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:05.175143 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0254843e-3cc9-4033-9333-8e9dafa105e5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:05.339237 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-536a9f3a-3c86-4bce-8474-c0de6b1f93ea tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:05.351950 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-536a9f3a-3c86-4bce-8474-c0de6b1f93ea tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.959461 Feb 08 16:42:05.352647 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 51/98] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:04 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:05.496565 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-8d986127-9c67-4d54-9711-745b0d2c8169 req-d52d4a33-0eab-4d86-8b0e-e9715771976d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ba1bca6-d50c-4032-809e-46b9ecbbf304", "tag": "8ada1591-1e3d-4284-b7ae-9c7a774e81b8"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:42:05.498482 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:42:05.498482 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:42:05.505937 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-8d986127-9c67-4d54-9711-745b0d2c8169 req-d52d4a33-0eab-4d86-8b0e-e9715771976d service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:05.506893 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-8d986127-9c67-4d54-9711-745b0d2c8169 req-d52d4a33-0eab-4d86-8b0e-e9715771976d service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:05.509655 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0254843e-3cc9-4033-9333-8e9dafa105e5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:05.519032 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-0254843e-3cc9-4033-9333-8e9dafa105e5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.360496 Feb 08 16:42:05.520180 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 48/99] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:05 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:05.521796 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-8d986127-9c67-4d54-9711-745b0d2c8169 req-d52d4a33-0eab-4d86-8b0e-e9715771976d service nova] Creating event network-changed:8ada1591-1e3d-4284-b7ae-9c7a774e81b8 for instance 4ba1bca6-d50c-4032-809e-46b9ecbbf304 on hv-cinder-82786 Feb 08 16:42:05.527670 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-8d986127-9c67-4d54-9711-745b0d2c8169 req-d52d4a33-0eab-4d86-8b0e-e9715771976d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173792 Feb 08 16:42:05.528423 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 52/100] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:42:05.653028 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-4503e6a4-4459-4a7d-9b69-1f5b3570e61a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:05.654303 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4503e6a4-4459-4a7d-9b69-1f5b3570e61a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:05.661671 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4503e6a4-4459-4a7d-9b69-1f5b3570e61a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:05.662125 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4503e6a4-4459-4a7d-9b69-1f5b3570e61a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:05.664139 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4503e6a4-4459-4a7d-9b69-1f5b3570e61a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:05.664748 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4503e6a4-4459-4a7d-9b69-1f5b3570e61a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:05.764416 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4503e6a4-4459-4a7d-9b69-1f5b3570e61a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:05.773267 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-4503e6a4-4459-4a7d-9b69-1f5b3570e61a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1295 microversion: 2.1 time: 0.124622 Feb 08 16:42:05.773969 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 49/101] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:05 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1295 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:42:06.161683 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-f8ead4e6-a096-40fd-83f9-2d2b47e8297f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:06.162753 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-f8ead4e6-a096-40fd-83f9-2d2b47e8297f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:06.169088 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f8ead4e6-a096-40fd-83f9-2d2b47e8297f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:06.169548 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f8ead4e6-a096-40fd-83f9-2d2b47e8297f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:06.170333 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f8ead4e6-a096-40fd-83f9-2d2b47e8297f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:06.170799 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f8ead4e6-a096-40fd-83f9-2d2b47e8297f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:06.369653 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-06a67c0c-bc79-4b7b-a0dc-ee88b6556fef tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:06.370297 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-06a67c0c-bc79-4b7b-a0dc-ee88b6556fef tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:06.376893 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-06a67c0c-bc79-4b7b-a0dc-ee88b6556fef tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:06.377353 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-06a67c0c-bc79-4b7b-a0dc-ee88b6556fef tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:06.378140 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-06a67c0c-bc79-4b7b-a0dc-ee88b6556fef tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:06.378579 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-06a67c0c-bc79-4b7b-a0dc-ee88b6556fef tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:06.383215 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-f8ead4e6-a096-40fd-83f9-2d2b47e8297f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:06.391813 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-f8ead4e6-a096-40fd-83f9-2d2b47e8297f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:06.393431 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-f8ead4e6-a096-40fd-83f9-2d2b47e8297f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:06.394536 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-f8ead4e6-a096-40fd-83f9-2d2b47e8297f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.237082 Feb 08 16:42:06.395557 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 53/102] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:06 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:06.529293 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-06a67c0c-bc79-4b7b-a0dc-ee88b6556fef tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:06.536629 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-7926dc8b-289d-41e6-baa3-59ceea8e78b7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:06.538182 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-7926dc8b-289d-41e6-baa3-59ceea8e78b7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:06.541516 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-06a67c0c-bc79-4b7b-a0dc-ee88b6556fef tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.176048 Feb 08 16:42:06.542471 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 50/103] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:06 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:42:06.545340 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7926dc8b-289d-41e6-baa3-59ceea8e78b7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:06.545962 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7926dc8b-289d-41e6-baa3-59ceea8e78b7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:06.546761 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7926dc8b-289d-41e6-baa3-59ceea8e78b7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:06.547202 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7926dc8b-289d-41e6-baa3-59ceea8e78b7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:06.696162 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-7926dc8b-289d-41e6-baa3-59ceea8e78b7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:06.703746 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-7926dc8b-289d-41e6-baa3-59ceea8e78b7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.171210 Feb 08 16:42:06.704368 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 54/104] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:06 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:42:06.791077 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-8bfa1d49-3e60-4617-8d03-50fcd4a4d1dd tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:06.791696 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-8bfa1d49-3e60-4617-8d03-50fcd4a4d1dd tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:06.797705 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8bfa1d49-3e60-4617-8d03-50fcd4a4d1dd tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:06.798166 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8bfa1d49-3e60-4617-8d03-50fcd4a4d1dd tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:06.798954 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8bfa1d49-3e60-4617-8d03-50fcd4a4d1dd tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:06.799392 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8bfa1d49-3e60-4617-8d03-50fcd4a4d1dd tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:06.942086 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-8bfa1d49-3e60-4617-8d03-50fcd4a4d1dd tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:06.949959 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-8bfa1d49-3e60-4617-8d03-50fcd4a4d1dd tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.163147 Feb 08 16:42:06.950840 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 51/105] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:06 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:07.417740 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-5add6df2-27bb-4e91-91c5-de28263bfc6b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:07.418349 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-5add6df2-27bb-4e91-91c5-de28263bfc6b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:07.424577 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5add6df2-27bb-4e91-91c5-de28263bfc6b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:07.425030 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5add6df2-27bb-4e91-91c5-de28263bfc6b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:07.425864 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5add6df2-27bb-4e91-91c5-de28263bfc6b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:07.426307 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5add6df2-27bb-4e91-91c5-de28263bfc6b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:07.545856 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-4850b392-e6d7-4bb0-bcec-02c42b1e79b5 req-17b28983-5907-4af6-b6ef-1b85d27701a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3491de9b-89ec-4861-b97f-f32158e658cc", "tag": "34c8d083-5aff-4e0c-ab35-54f6088f7587"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:42:07.548939 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:42:07.548939 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:42:07.560302 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-4850b392-e6d7-4bb0-bcec-02c42b1e79b5 req-17b28983-5907-4af6-b6ef-1b85d27701a5 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:07.560749 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-4850b392-e6d7-4bb0-bcec-02c42b1e79b5 req-17b28983-5907-4af6-b6ef-1b85d27701a5 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:07.572996 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-5add6df2-27bb-4e91-91c5-de28263bfc6b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:07.580712 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-4850b392-e6d7-4bb0-bcec-02c42b1e79b5 req-17b28983-5907-4af6-b6ef-1b85d27701a5 service nova] Creating event network-changed:34c8d083-5aff-4e0c-ab35-54f6088f7587 for instance 3491de9b-89ec-4861-b97f-f32158e658cc on hv-cinder-82786 Feb 08 16:42:07.581265 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-4850b392-e6d7-4bb0-bcec-02c42b1e79b5 req-17b28983-5907-4af6-b6ef-1b85d27701a5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122901) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 08 16:42:07.582337 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8889c748-d158-49e2-84ce-d3dd253b5605 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:07.582779 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8889c748-d158-49e2-84ce-d3dd253b5605 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:07.583578 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8889c748-d158-49e2-84ce-d3dd253b5605 None None] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:07.584034 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8889c748-d158-49e2-84ce-d3dd253b5605 None None] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:07.584271 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-5add6df2-27bb-4e91-91c5-de28263bfc6b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:07.585985 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-5add6df2-27bb-4e91-91c5-de28263bfc6b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:07.587081 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-5add6df2-27bb-4e91-91c5-de28263bfc6b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.173083 Feb 08 16:42:07.598377 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 55/106] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:07 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:07.598377 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-f5fee95a-e0e2-4f38-b11b-815c486a0afc tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:07.598377 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-f5fee95a-e0e2-4f38-b11b-815c486a0afc tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:07.598751 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.compute.rpcapi [None req-8889c748-d158-49e2-84ce-d3dd253b5605 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Feb 08 16:42:07.598751 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8889c748-d158-49e2-84ce-d3dd253b5605 None None] Releasing lock "compute-rpcapi-router" {{(pid=122901) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 08 16:42:07.598889 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f5fee95a-e0e2-4f38-b11b-815c486a0afc tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:07.599269 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f5fee95a-e0e2-4f38-b11b-815c486a0afc tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:07.602841 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f5fee95a-e0e2-4f38-b11b-815c486a0afc tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:07.602841 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f5fee95a-e0e2-4f38-b11b-815c486a0afc tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:07.626772 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-8889c748-d158-49e2-84ce-d3dd253b5605 None None] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084488 Feb 08 16:42:07.628289 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 52/107] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:42:07.725802 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-6725345f-acb0-490e-bff5-9a896eff041e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:07.726668 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-6725345f-acb0-490e-bff5-9a896eff041e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:07.733718 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6725345f-acb0-490e-bff5-9a896eff041e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:07.734416 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6725345f-acb0-490e-bff5-9a896eff041e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:07.735325 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6725345f-acb0-490e-bff5-9a896eff041e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:07.736078 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6725345f-acb0-490e-bff5-9a896eff041e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:07.758984 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-f5fee95a-e0e2-4f38-b11b-815c486a0afc tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:07.766360 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-f5fee95a-e0e2-4f38-b11b-815c486a0afc tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.177300 Feb 08 16:42:07.770260 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 56/108] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:07 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:07.878092 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-6725345f-acb0-490e-bff5-9a896eff041e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:07.886176 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-6725345f-acb0-490e-bff5-9a896eff041e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.166806 Feb 08 16:42:07.886751 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 53/109] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:07 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:07.965909 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-17cdb3df-49c1-440d-9c94-a702758d48bb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:07.966517 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-17cdb3df-49c1-440d-9c94-a702758d48bb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:07.972264 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-17cdb3df-49c1-440d-9c94-a702758d48bb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:07.972713 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-17cdb3df-49c1-440d-9c94-a702758d48bb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:07.973844 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-17cdb3df-49c1-440d-9c94-a702758d48bb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:07.973968 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-17cdb3df-49c1-440d-9c94-a702758d48bb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:08.113869 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-17cdb3df-49c1-440d-9c94-a702758d48bb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:08.121488 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-17cdb3df-49c1-440d-9c94-a702758d48bb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.159130 Feb 08 16:42:08.122072 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 57/110] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:07 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:08.605415 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-dd2928a9-8b7a-4dd6-b380-2c8d602eaca7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:08.605944 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-dd2928a9-8b7a-4dd6-b380-2c8d602eaca7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:08.611801 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dd2928a9-8b7a-4dd6-b380-2c8d602eaca7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:08.612260 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dd2928a9-8b7a-4dd6-b380-2c8d602eaca7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:08.613034 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dd2928a9-8b7a-4dd6-b380-2c8d602eaca7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:08.613473 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dd2928a9-8b7a-4dd6-b380-2c8d602eaca7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:08.745701 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-dd2928a9-8b7a-4dd6-b380-2c8d602eaca7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:08.753362 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-dd2928a9-8b7a-4dd6-b380-2c8d602eaca7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:08.754845 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-dd2928a9-8b7a-4dd6-b380-2c8d602eaca7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:08.756016 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-dd2928a9-8b7a-4dd6-b380-2c8d602eaca7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.154303 Feb 08 16:42:08.756832 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 54/111] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:08 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:42:08.781969 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-453ceffb-30a6-4f25-b0cc-2118ef03d67b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:08.782606 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-453ceffb-30a6-4f25-b0cc-2118ef03d67b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:08.789066 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-453ceffb-30a6-4f25-b0cc-2118ef03d67b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:08.789507 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-453ceffb-30a6-4f25-b0cc-2118ef03d67b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:08.790269 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-453ceffb-30a6-4f25-b0cc-2118ef03d67b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:08.790730 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-453ceffb-30a6-4f25-b0cc-2118ef03d67b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:08.902699 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-85008001-51c0-447f-a96f-19ebd18e149c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:08.903420 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-85008001-51c0-447f-a96f-19ebd18e149c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:08.909306 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-85008001-51c0-447f-a96f-19ebd18e149c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:08.909756 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-85008001-51c0-447f-a96f-19ebd18e149c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:08.910538 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-85008001-51c0-447f-a96f-19ebd18e149c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:08.910999 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-85008001-51c0-447f-a96f-19ebd18e149c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:08.923650 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-453ceffb-30a6-4f25-b0cc-2118ef03d67b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:08.931124 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-453ceffb-30a6-4f25-b0cc-2118ef03d67b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.152735 Feb 08 16:42:08.931688 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 58/112] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:08 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:09.046062 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-85008001-51c0-447f-a96f-19ebd18e149c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:09.053442 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-85008001-51c0-447f-a96f-19ebd18e149c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.154245 Feb 08 16:42:09.054104 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 55/113] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:08 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:09.137888 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-eda3c125-1a35-47a8-8f36-2e4498c8325c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:09.138431 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-eda3c125-1a35-47a8-8f36-2e4498c8325c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:09.144233 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eda3c125-1a35-47a8-8f36-2e4498c8325c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:09.144682 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eda3c125-1a35-47a8-8f36-2e4498c8325c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:09.145453 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eda3c125-1a35-47a8-8f36-2e4498c8325c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:09.145888 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eda3c125-1a35-47a8-8f36-2e4498c8325c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:09.681122 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-eda3c125-1a35-47a8-8f36-2e4498c8325c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:09.691968 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-eda3c125-1a35-47a8-8f36-2e4498c8325c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.557660 Feb 08 16:42:09.703451 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 59/114] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:09 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:09.777579 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-7c1db034-cd56-4feb-a834-07b1bdc29307 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:09.779916 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7c1db034-cd56-4feb-a834-07b1bdc29307 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:09.787211 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7c1db034-cd56-4feb-a834-07b1bdc29307 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:09.788096 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7c1db034-cd56-4feb-a834-07b1bdc29307 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:09.789291 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7c1db034-cd56-4feb-a834-07b1bdc29307 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:09.790153 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7c1db034-cd56-4feb-a834-07b1bdc29307 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:09.951182 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-a2fe1803-7237-4733-8074-10894ad322a6 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:09.953348 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-a2fe1803-7237-4733-8074-10894ad322a6 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:09.967374 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a2fe1803-7237-4733-8074-10894ad322a6 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:09.967994 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a2fe1803-7237-4733-8074-10894ad322a6 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:09.969198 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a2fe1803-7237-4733-8074-10894ad322a6 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:09.969869 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a2fe1803-7237-4733-8074-10894ad322a6 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:10.137787 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7c1db034-cd56-4feb-a834-07b1bdc29307 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:10.147352 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7c1db034-cd56-4feb-a834-07b1bdc29307 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:10.149313 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7c1db034-cd56-4feb-a834-07b1bdc29307 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:10.150722 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-7c1db034-cd56-4feb-a834-07b1bdc29307 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.380431 Feb 08 16:42:10.151503 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 56/115] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:09 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:10.165830 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-1b9b66d7-57fb-4689-a23c-57a717f1826f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:10.166546 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-1b9b66d7-57fb-4689-a23c-57a717f1826f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:10.176191 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1b9b66d7-57fb-4689-a23c-57a717f1826f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:10.176932 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1b9b66d7-57fb-4689-a23c-57a717f1826f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:10.178439 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1b9b66d7-57fb-4689-a23c-57a717f1826f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:10.179828 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1b9b66d7-57fb-4689-a23c-57a717f1826f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:10.463067 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-a2fe1803-7237-4733-8074-10894ad322a6 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:10.471266 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-a2fe1803-7237-4733-8074-10894ad322a6 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.527541 Feb 08 16:42:10.472416 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 60/116] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:09 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:10.647843 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-e0d5ec45-8989-4096-bd5f-4060728f9271 req-9e454241-fe9e-414e-8111-7c8a7dea98b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "136b1df1-a111-4a7b-8a8d-5e095dadc764", "tag": "f72c3bbd-5f67-4f43-a4c1-f7f6cc240f10"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:42:10.650273 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:42:10.650273 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:42:10.665081 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-e0d5ec45-8989-4096-bd5f-4060728f9271 req-9e454241-fe9e-414e-8111-7c8a7dea98b1 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:10.675479 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-e0d5ec45-8989-4096-bd5f-4060728f9271 req-9e454241-fe9e-414e-8111-7c8a7dea98b1 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:10.700978 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-e0d5ec45-8989-4096-bd5f-4060728f9271 req-9e454241-fe9e-414e-8111-7c8a7dea98b1 service nova] Creating event network-changed:f72c3bbd-5f67-4f43-a4c1-f7f6cc240f10 for instance 136b1df1-a111-4a7b-8a8d-5e095dadc764 on hv-cinder-82786 Feb 08 16:42:10.710593 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-1b9b66d7-57fb-4689-a23c-57a717f1826f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:10.713154 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-e0d5ec45-8989-4096-bd5f-4060728f9271 req-9e454241-fe9e-414e-8111-7c8a7dea98b1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067956 Feb 08 16:42:10.716963 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 61/117] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:42:10.723027 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-1b9b66d7-57fb-4689-a23c-57a717f1826f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.567025 Feb 08 16:42:10.723673 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 57/118] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:10 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:10.728648 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-a1d0699c-9ca4-4f32-a3fa-a2140d0a4dfc tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:10.730228 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-a1d0699c-9ca4-4f32-a3fa-a2140d0a4dfc tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:10.744583 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a1d0699c-9ca4-4f32-a3fa-a2140d0a4dfc tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:10.746373 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a1d0699c-9ca4-4f32-a3fa-a2140d0a4dfc tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:10.749141 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a1d0699c-9ca4-4f32-a3fa-a2140d0a4dfc tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:10.750931 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a1d0699c-9ca4-4f32-a3fa-a2140d0a4dfc tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:11.169536 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-dcf6d2c9-8943-4162-b059-ca771eef9bb8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:11.170185 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-dcf6d2c9-8943-4162-b059-ca771eef9bb8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:11.180547 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dcf6d2c9-8943-4162-b059-ca771eef9bb8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:11.181051 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dcf6d2c9-8943-4162-b059-ca771eef9bb8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:11.182972 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dcf6d2c9-8943-4162-b059-ca771eef9bb8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:11.183427 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dcf6d2c9-8943-4162-b059-ca771eef9bb8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:11.504182 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-dcf6d2c9-8943-4162-b059-ca771eef9bb8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:11.527829 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-dcf6d2c9-8943-4162-b059-ca771eef9bb8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:11.531413 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-dcf6d2c9-8943-4162-b059-ca771eef9bb8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:11.532676 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-dcf6d2c9-8943-4162-b059-ca771eef9bb8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.367049 Feb 08 16:42:11.533298 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 58/119] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:11 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:42:11.538175 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d33010d6-ce5e-4796-a3bd-bbbe5a04cacf tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:11.539470 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-d33010d6-ce5e-4796-a3bd-bbbe5a04cacf tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:11.545632 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-a1d0699c-9ca4-4f32-a3fa-a2140d0a4dfc tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:11.552086 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d33010d6-ce5e-4796-a3bd-bbbe5a04cacf tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:11.552982 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d33010d6-ce5e-4796-a3bd-bbbe5a04cacf tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:11.554118 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d33010d6-ce5e-4796-a3bd-bbbe5a04cacf tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:11.554786 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d33010d6-ce5e-4796-a3bd-bbbe5a04cacf tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:11.557588 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-a1d0699c-9ca4-4f32-a3fa-a2140d0a4dfc tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.838955 Feb 08 16:42:11.558215 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 62/120] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:10 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:11.718512 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-ba492ada-7621-4952-a8a4-741fff09917d req-703712c7-124c-4be2-8f7d-779875ae399a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da00c476-8246-413e-889c-d22fe63e2ef8", "tag": "dc601835-5363-4bdf-9b05-9e711057cbd2"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:42:11.720099 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:42:11.720099 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:42:11.731150 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-ba492ada-7621-4952-a8a4-741fff09917d req-703712c7-124c-4be2-8f7d-779875ae399a service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:11.731532 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-ba492ada-7621-4952-a8a4-741fff09917d req-703712c7-124c-4be2-8f7d-779875ae399a service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:11.748961 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-ba492ada-7621-4952-a8a4-741fff09917d req-703712c7-124c-4be2-8f7d-779875ae399a service nova] Creating event network-changed:dc601835-5363-4bdf-9b05-9e711057cbd2 for instance da00c476-8246-413e-889c-d22fe63e2ef8 on hv-cinder-82786 Feb 08 16:42:11.758003 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-ba492ada-7621-4952-a8a4-741fff09917d req-703712c7-124c-4be2-8f7d-779875ae399a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043475 Feb 08 16:42:11.761600 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 63/121] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:42:11.766788 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-469eabfe-b5e8-43f3-9796-949c77b223dc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:11.769200 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-469eabfe-b5e8-43f3-9796-949c77b223dc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:11.776526 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-469eabfe-b5e8-43f3-9796-949c77b223dc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:11.777407 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-469eabfe-b5e8-43f3-9796-949c77b223dc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:11.778510 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-469eabfe-b5e8-43f3-9796-949c77b223dc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:11.779106 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-469eabfe-b5e8-43f3-9796-949c77b223dc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:11.866853 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d33010d6-ce5e-4796-a3bd-bbbe5a04cacf tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:11.874311 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d33010d6-ce5e-4796-a3bd-bbbe5a04cacf tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.339888 Feb 08 16:42:11.875099 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 59/122] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:11 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:12.441232 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-469eabfe-b5e8-43f3-9796-949c77b223dc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:12.458314 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-469eabfe-b5e8-43f3-9796-949c77b223dc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.695270 Feb 08 16:42:12.458897 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 64/123] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:11 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:12.558115 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-61497f1e-bee3-48f6-92b1-f2223cc60929 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:12.559538 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-61497f1e-bee3-48f6-92b1-f2223cc60929 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:12.577061 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-38b3816f-e24a-46a1-b148-1743df7b0f49 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:12.578469 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-38b3816f-e24a-46a1-b148-1743df7b0f49 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:12.582030 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-61497f1e-bee3-48f6-92b1-f2223cc60929 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:12.583366 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-61497f1e-bee3-48f6-92b1-f2223cc60929 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:12.585634 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-61497f1e-bee3-48f6-92b1-f2223cc60929 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:12.590431 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-61497f1e-bee3-48f6-92b1-f2223cc60929 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:12.617034 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-38b3816f-e24a-46a1-b148-1743df7b0f49 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:12.618935 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-38b3816f-e24a-46a1-b148-1743df7b0f49 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:12.620320 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-38b3816f-e24a-46a1-b148-1743df7b0f49 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:12.622008 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-38b3816f-e24a-46a1-b148-1743df7b0f49 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:12.827887 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-61497f1e-bee3-48f6-92b1-f2223cc60929 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:12.839166 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-61497f1e-bee3-48f6-92b1-f2223cc60929 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:12.840902 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-61497f1e-bee3-48f6-92b1-f2223cc60929 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:12.842370 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-61497f1e-bee3-48f6-92b1-f2223cc60929 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.288628 Feb 08 16:42:12.850044 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 60/124] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:12 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:12.898346 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-df216f6c-dff2-40a6-b3fa-92e2cb7f04cc tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:12.898876 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-df216f6c-dff2-40a6-b3fa-92e2cb7f04cc tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:12.906837 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-df216f6c-dff2-40a6-b3fa-92e2cb7f04cc tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:12.907320 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-df216f6c-dff2-40a6-b3fa-92e2cb7f04cc tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:12.908360 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-df216f6c-dff2-40a6-b3fa-92e2cb7f04cc tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:12.909288 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-df216f6c-dff2-40a6-b3fa-92e2cb7f04cc tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:12.945333 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-38b3816f-e24a-46a1-b148-1743df7b0f49 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:12.953504 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-38b3816f-e24a-46a1-b148-1743df7b0f49 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.382403 Feb 08 16:42:12.954086 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 65/125] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:12 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:13.058344 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-df216f6c-dff2-40a6-b3fa-92e2cb7f04cc tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:13.065592 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-df216f6c-dff2-40a6-b3fa-92e2cb7f04cc tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.177175 Feb 08 16:42:13.075942 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 61/126] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:12 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:13.473997 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-92177f36-dc8b-4f23-8954-7afb2530fa87 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:13.476573 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-92177f36-dc8b-4f23-8954-7afb2530fa87 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:13.482371 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-92177f36-dc8b-4f23-8954-7afb2530fa87 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:13.482815 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-92177f36-dc8b-4f23-8954-7afb2530fa87 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:13.483608 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-92177f36-dc8b-4f23-8954-7afb2530fa87 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:13.484077 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-92177f36-dc8b-4f23-8954-7afb2530fa87 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:13.634765 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-92177f36-dc8b-4f23-8954-7afb2530fa87 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:13.644119 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-92177f36-dc8b-4f23-8954-7afb2530fa87 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.173594 Feb 08 16:42:13.655567 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 66/127] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:13 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:13.860351 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-945efdb7-7ee7-4f07-a0db-a07e758fdda2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:13.860979 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-945efdb7-7ee7-4f07-a0db-a07e758fdda2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:13.867555 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-945efdb7-7ee7-4f07-a0db-a07e758fdda2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:13.868028 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-945efdb7-7ee7-4f07-a0db-a07e758fdda2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:13.868801 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-945efdb7-7ee7-4f07-a0db-a07e758fdda2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:13.869235 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-945efdb7-7ee7-4f07-a0db-a07e758fdda2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:13.974051 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c133fb9a-68bb-400c-b416-687a0b496253 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:13.975312 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c133fb9a-68bb-400c-b416-687a0b496253 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:13.987279 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c133fb9a-68bb-400c-b416-687a0b496253 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:13.987903 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c133fb9a-68bb-400c-b416-687a0b496253 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:13.988892 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c133fb9a-68bb-400c-b416-687a0b496253 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:13.989434 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c133fb9a-68bb-400c-b416-687a0b496253 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:14.064865 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-945efdb7-7ee7-4f07-a0db-a07e758fdda2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:14.077072 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-945efdb7-7ee7-4f07-a0db-a07e758fdda2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:14.078865 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-945efdb7-7ee7-4f07-a0db-a07e758fdda2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:14.080229 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-945efdb7-7ee7-4f07-a0db-a07e758fdda2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.223361 Feb 08 16:42:14.084708 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 62/128] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:13 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:14.089265 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-bf201f60-9c05-455c-b9fd-839a043d4447 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:14.090689 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-bf201f60-9c05-455c-b9fd-839a043d4447 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:14.096581 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bf201f60-9c05-455c-b9fd-839a043d4447 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:14.097034 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bf201f60-9c05-455c-b9fd-839a043d4447 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:14.097819 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bf201f60-9c05-455c-b9fd-839a043d4447 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:14.098499 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bf201f60-9c05-455c-b9fd-839a043d4447 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:14.151221 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c133fb9a-68bb-400c-b416-687a0b496253 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:14.158647 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c133fb9a-68bb-400c-b416-687a0b496253 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.188961 Feb 08 16:42:14.159204 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 67/129] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:13 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:14.250635 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-bf201f60-9c05-455c-b9fd-839a043d4447 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:14.262021 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-bf201f60-9c05-455c-b9fd-839a043d4447 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.176452 Feb 08 16:42:14.262606 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 63/130] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:14 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:14.662082 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-810f81a0-ae48-4380-8746-135b3ac5466d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:14.662840 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-810f81a0-ae48-4380-8746-135b3ac5466d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:14.668868 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-810f81a0-ae48-4380-8746-135b3ac5466d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:14.669320 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-810f81a0-ae48-4380-8746-135b3ac5466d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:14.670228 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-810f81a0-ae48-4380-8746-135b3ac5466d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:14.670676 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-810f81a0-ae48-4380-8746-135b3ac5466d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:14.809225 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-810f81a0-ae48-4380-8746-135b3ac5466d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:14.816425 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-810f81a0-ae48-4380-8746-135b3ac5466d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.157946 Feb 08 16:42:14.817012 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 68/131] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:14 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:15.098681 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-c3520079-a246-4784-942c-31b323c60154 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:15.100119 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-c3520079-a246-4784-942c-31b323c60154 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:15.106611 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c3520079-a246-4784-942c-31b323c60154 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:15.107405 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c3520079-a246-4784-942c-31b323c60154 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:15.108376 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c3520079-a246-4784-942c-31b323c60154 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:15.108960 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c3520079-a246-4784-942c-31b323c60154 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:15.175734 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-13e35622-4e81-4414-8439-7ed583e16571 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:15.176719 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-13e35622-4e81-4414-8439-7ed583e16571 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:15.183957 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-13e35622-4e81-4414-8439-7ed583e16571 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:15.184630 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-13e35622-4e81-4414-8439-7ed583e16571 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:15.185611 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-13e35622-4e81-4414-8439-7ed583e16571 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:15.186229 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-13e35622-4e81-4414-8439-7ed583e16571 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:15.342398 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c3520079-a246-4784-942c-31b323c60154 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:15.353236 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-13e35622-4e81-4414-8439-7ed583e16571 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:15.364740 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c3520079-a246-4784-942c-31b323c60154 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:15.367084 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c3520079-a246-4784-942c-31b323c60154 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:15.368654 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-c3520079-a246-4784-942c-31b323c60154 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.273582 Feb 08 16:42:15.371921 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-13e35622-4e81-4414-8439-7ed583e16571 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.199831 Feb 08 16:42:15.372444 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 69/132] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:15 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:42:15.376866 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e95ae00e-04a5-400b-b564-eb498f1560b8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:15.377472 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e95ae00e-04a5-400b-b564-eb498f1560b8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:15.380196 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 64/133] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:15 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:15.383785 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e95ae00e-04a5-400b-b564-eb498f1560b8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:15.384233 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e95ae00e-04a5-400b-b564-eb498f1560b8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:15.385035 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e95ae00e-04a5-400b-b564-eb498f1560b8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:15.385470 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e95ae00e-04a5-400b-b564-eb498f1560b8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:15.530202 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e95ae00e-04a5-400b-b564-eb498f1560b8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:15.538495 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e95ae00e-04a5-400b-b564-eb498f1560b8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.164708 Feb 08 16:42:15.539206 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 70/134] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:15 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:15.833573 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-035eae6b-6a50-46d1-af7a-7539ed3e2aa0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:15.834196 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-035eae6b-6a50-46d1-af7a-7539ed3e2aa0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:15.840740 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-035eae6b-6a50-46d1-af7a-7539ed3e2aa0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:15.841191 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-035eae6b-6a50-46d1-af7a-7539ed3e2aa0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:15.841969 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-035eae6b-6a50-46d1-af7a-7539ed3e2aa0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:15.842409 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-035eae6b-6a50-46d1-af7a-7539ed3e2aa0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:16.000418 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-035eae6b-6a50-46d1-af7a-7539ed3e2aa0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:16.008860 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-035eae6b-6a50-46d1-af7a-7539ed3e2aa0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.178944 Feb 08 16:42:16.009446 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 65/135] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:15 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:16.389493 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-6028ac2f-b6e0-4216-b1c2-c4af883d345f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:16.390151 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-6028ac2f-b6e0-4216-b1c2-c4af883d345f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:16.396588 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6028ac2f-b6e0-4216-b1c2-c4af883d345f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:16.397046 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-94b185ce-54a6-49bf-a4d6-55017035e9b6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:16.397496 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6028ac2f-b6e0-4216-b1c2-c4af883d345f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:16.398366 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-94b185ce-54a6-49bf-a4d6-55017035e9b6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:16.398551 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6028ac2f-b6e0-4216-b1c2-c4af883d345f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:16.398949 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6028ac2f-b6e0-4216-b1c2-c4af883d345f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:16.405693 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-94b185ce-54a6-49bf-a4d6-55017035e9b6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:16.406211 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-94b185ce-54a6-49bf-a4d6-55017035e9b6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:16.407058 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-94b185ce-54a6-49bf-a4d6-55017035e9b6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:16.407555 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-94b185ce-54a6-49bf-a4d6-55017035e9b6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:16.547725 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-6028ac2f-b6e0-4216-b1c2-c4af883d345f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:16.555377 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-6028ac2f-b6e0-4216-b1c2-c4af883d345f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.169675 Feb 08 16:42:16.556498 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 71/136] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:16 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:16.561093 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-95d4e2f3-7aa1-40e9-93cc-04fb4ad151f7 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:16.561807 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-95d4e2f3-7aa1-40e9-93cc-04fb4ad151f7 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:16.566136 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-94b185ce-54a6-49bf-a4d6-55017035e9b6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:16.567918 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-95d4e2f3-7aa1-40e9-93cc-04fb4ad151f7 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:16.568476 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-95d4e2f3-7aa1-40e9-93cc-04fb4ad151f7 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:16.569484 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-95d4e2f3-7aa1-40e9-93cc-04fb4ad151f7 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:16.570548 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-95d4e2f3-7aa1-40e9-93cc-04fb4ad151f7 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:16.579092 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-94b185ce-54a6-49bf-a4d6-55017035e9b6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:16.580871 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-94b185ce-54a6-49bf-a4d6-55017035e9b6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:16.582159 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-94b185ce-54a6-49bf-a4d6-55017035e9b6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.189028 Feb 08 16:42:16.583337 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 66/137] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:16 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:42:16.717555 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-95d4e2f3-7aa1-40e9-93cc-04fb4ad151f7 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:16.725190 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-95d4e2f3-7aa1-40e9-93cc-04fb4ad151f7 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.167378 Feb 08 16:42:16.725800 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 72/138] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:16 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:17.026380 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-7f769b1e-880a-4dc9-b02c-83e80163ee57 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:17.026967 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7f769b1e-880a-4dc9-b02c-83e80163ee57 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:17.033092 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7f769b1e-880a-4dc9-b02c-83e80163ee57 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:17.033433 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7f769b1e-880a-4dc9-b02c-83e80163ee57 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:17.034610 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7f769b1e-880a-4dc9-b02c-83e80163ee57 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:17.035435 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7f769b1e-880a-4dc9-b02c-83e80163ee57 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:17.184740 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7f769b1e-880a-4dc9-b02c-83e80163ee57 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:17.192823 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-7f769b1e-880a-4dc9-b02c-83e80163ee57 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.170487 Feb 08 16:42:17.193582 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 67/139] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:17 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:17.572016 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-4bb4e548-8a43-4d07-a75f-2e9d34c2af6f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:17.572763 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-4bb4e548-8a43-4d07-a75f-2e9d34c2af6f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:17.578476 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4bb4e548-8a43-4d07-a75f-2e9d34c2af6f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:17.578924 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4bb4e548-8a43-4d07-a75f-2e9d34c2af6f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:17.579696 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4bb4e548-8a43-4d07-a75f-2e9d34c2af6f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:17.580303 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4bb4e548-8a43-4d07-a75f-2e9d34c2af6f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:17.604815 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-6de7a164-8894-4c7b-b3c8-421047076fd5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:17.605635 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-6de7a164-8894-4c7b-b3c8-421047076fd5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:17.613476 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6de7a164-8894-4c7b-b3c8-421047076fd5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:17.614183 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6de7a164-8894-4c7b-b3c8-421047076fd5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:17.615088 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6de7a164-8894-4c7b-b3c8-421047076fd5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:17.615963 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6de7a164-8894-4c7b-b3c8-421047076fd5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:17.778513 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-6de7a164-8894-4c7b-b3c8-421047076fd5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:17.787040 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-6de7a164-8894-4c7b-b3c8-421047076fd5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:17.789314 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-6de7a164-8894-4c7b-b3c8-421047076fd5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:17.790550 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-6de7a164-8894-4c7b-b3c8-421047076fd5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.191815 Feb 08 16:42:17.791473 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 68/140] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:17 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:17.795824 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-359c8fb2-edb2-4c2a-9e9e-90dcdf07cd7f tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:17.796638 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-359c8fb2-edb2-4c2a-9e9e-90dcdf07cd7f tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:17.802343 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-359c8fb2-edb2-4c2a-9e9e-90dcdf07cd7f tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:17.802733 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-359c8fb2-edb2-4c2a-9e9e-90dcdf07cd7f tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:17.803580 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-359c8fb2-edb2-4c2a-9e9e-90dcdf07cd7f tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:17.804074 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-359c8fb2-edb2-4c2a-9e9e-90dcdf07cd7f tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:17.862621 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-4bb4e548-8a43-4d07-a75f-2e9d34c2af6f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:17.870337 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-4bb4e548-8a43-4d07-a75f-2e9d34c2af6f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.302208 Feb 08 16:42:17.871168 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 73/141] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:17 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:17.962100 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-359c8fb2-edb2-4c2a-9e9e-90dcdf07cd7f tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:17.979941 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-359c8fb2-edb2-4c2a-9e9e-90dcdf07cd7f tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.179707 Feb 08 16:42:17.979941 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 69/142] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:17 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:18.210938 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e764f819-ab9b-4964-8225-10feb2fc6dcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:18.211539 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e764f819-ab9b-4964-8225-10feb2fc6dcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:18.217319 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e764f819-ab9b-4964-8225-10feb2fc6dcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:18.217766 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e764f819-ab9b-4964-8225-10feb2fc6dcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:18.218555 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e764f819-ab9b-4964-8225-10feb2fc6dcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:18.218986 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e764f819-ab9b-4964-8225-10feb2fc6dcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:18.489077 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e764f819-ab9b-4964-8225-10feb2fc6dcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:18.496991 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e764f819-ab9b-4964-8225-10feb2fc6dcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.290381 Feb 08 16:42:18.497550 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 74/143] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:18 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:18.808848 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-177745be-4942-4f7d-8025-1e7339a7e0bb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:18.809394 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-177745be-4942-4f7d-8025-1e7339a7e0bb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:18.815841 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-177745be-4942-4f7d-8025-1e7339a7e0bb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:18.816363 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-177745be-4942-4f7d-8025-1e7339a7e0bb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:18.817183 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-177745be-4942-4f7d-8025-1e7339a7e0bb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:18.817644 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-177745be-4942-4f7d-8025-1e7339a7e0bb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:18.889364 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-af3e1eb5-9048-4c01-97a8-eb7d943d4075 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:18.890012 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-af3e1eb5-9048-4c01-97a8-eb7d943d4075 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:18.895698 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-af3e1eb5-9048-4c01-97a8-eb7d943d4075 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:18.896174 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-af3e1eb5-9048-4c01-97a8-eb7d943d4075 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:18.896941 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-af3e1eb5-9048-4c01-97a8-eb7d943d4075 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:18.897378 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-af3e1eb5-9048-4c01-97a8-eb7d943d4075 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:18.950011 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-177745be-4942-4f7d-8025-1e7339a7e0bb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:18.957815 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-177745be-4942-4f7d-8025-1e7339a7e0bb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:18.959320 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-177745be-4942-4f7d-8025-1e7339a7e0bb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:18.960532 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-177745be-4942-4f7d-8025-1e7339a7e0bb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.155355 Feb 08 16:42:18.961099 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 70/144] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:18 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:18.992088 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-0f2aeebe-e2e1-4078-b2cd-1e2aa2b11dc7 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:18.993191 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-0f2aeebe-e2e1-4078-b2cd-1e2aa2b11dc7 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:18.999043 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0f2aeebe-e2e1-4078-b2cd-1e2aa2b11dc7 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:19.002657 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0f2aeebe-e2e1-4078-b2cd-1e2aa2b11dc7 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:19.003536 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0f2aeebe-e2e1-4078-b2cd-1e2aa2b11dc7 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:19.004076 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0f2aeebe-e2e1-4078-b2cd-1e2aa2b11dc7 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:19.031486 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-af3e1eb5-9048-4c01-97a8-eb7d943d4075 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:19.044148 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-af3e1eb5-9048-4c01-97a8-eb7d943d4075 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.158369 Feb 08 16:42:19.044723 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 75/145] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:18 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:42:19.142972 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0f2aeebe-e2e1-4078-b2cd-1e2aa2b11dc7 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:19.150844 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-0f2aeebe-e2e1-4078-b2cd-1e2aa2b11dc7 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.162898 Feb 08 16:42:19.151437 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 71/146] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:18 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:42:19.517155 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-efae200b-629d-42ec-9039-9a9c0627ebcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:19.517895 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-efae200b-629d-42ec-9039-9a9c0627ebcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:19.524978 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-efae200b-629d-42ec-9039-9a9c0627ebcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:19.525510 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-efae200b-629d-42ec-9039-9a9c0627ebcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:19.526394 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-efae200b-629d-42ec-9039-9a9c0627ebcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:19.527303 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-efae200b-629d-42ec-9039-9a9c0627ebcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:19.671815 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-efae200b-629d-42ec-9039-9a9c0627ebcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:19.679676 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-efae200b-629d-42ec-9039-9a9c0627ebcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.168456 Feb 08 16:42:19.680588 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 76/147] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:19 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:19.977972 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-27ff8e31-e7d0-44b6-bafc-c148c79c381a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:19.978534 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-27ff8e31-e7d0-44b6-bafc-c148c79c381a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:19.984457 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-27ff8e31-e7d0-44b6-bafc-c148c79c381a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:19.984904 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-27ff8e31-e7d0-44b6-bafc-c148c79c381a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:19.985673 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-27ff8e31-e7d0-44b6-bafc-c148c79c381a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:19.986104 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-27ff8e31-e7d0-44b6-bafc-c148c79c381a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:20.060704 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b610c40b-2887-4148-a969-088c8d07f816 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:20.061392 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b610c40b-2887-4148-a969-088c8d07f816 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:20.067408 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b610c40b-2887-4148-a969-088c8d07f816 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:20.067900 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b610c40b-2887-4148-a969-088c8d07f816 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:20.068691 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b610c40b-2887-4148-a969-088c8d07f816 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:20.069125 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b610c40b-2887-4148-a969-088c8d07f816 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:20.122335 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-27ff8e31-e7d0-44b6-bafc-c148c79c381a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:20.132068 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-27ff8e31-e7d0-44b6-bafc-c148c79c381a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:20.134501 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-27ff8e31-e7d0-44b6-bafc-c148c79c381a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:20.135635 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-27ff8e31-e7d0-44b6-bafc-c148c79c381a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.161715 Feb 08 16:42:20.136241 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 72/148] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:19 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:20.169381 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-dbd45e84-0f01-4400-90cd-c0941620ace5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:20.170025 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-dbd45e84-0f01-4400-90cd-c0941620ace5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:20.175782 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dbd45e84-0f01-4400-90cd-c0941620ace5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:20.176232 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dbd45e84-0f01-4400-90cd-c0941620ace5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:20.177008 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dbd45e84-0f01-4400-90cd-c0941620ace5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:20.177444 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dbd45e84-0f01-4400-90cd-c0941620ace5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:20.205140 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b610c40b-2887-4148-a969-088c8d07f816 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:20.212915 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b610c40b-2887-4148-a969-088c8d07f816 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.155841 Feb 08 16:42:20.213483 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 77/149] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:20 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:20.312937 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-dbd45e84-0f01-4400-90cd-c0941620ace5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:20.320877 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-dbd45e84-0f01-4400-90cd-c0941620ace5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.155130 Feb 08 16:42:20.321441 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 73/150] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:20 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:42:20.696575 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-8d1efe61-d546-4669-90b1-a35b13f0e6aa tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:20.697176 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-8d1efe61-d546-4669-90b1-a35b13f0e6aa tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:20.703235 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8d1efe61-d546-4669-90b1-a35b13f0e6aa tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:20.703734 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8d1efe61-d546-4669-90b1-a35b13f0e6aa tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:20.704601 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8d1efe61-d546-4669-90b1-a35b13f0e6aa tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:20.705073 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8d1efe61-d546-4669-90b1-a35b13f0e6aa tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:20.844111 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-8d1efe61-d546-4669-90b1-a35b13f0e6aa tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:20.853021 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-8d1efe61-d546-4669-90b1-a35b13f0e6aa tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.160212 Feb 08 16:42:20.871905 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 78/151] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:20 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:21.153373 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-a509f8e1-f3f2-4df7-84aa-427e484b3a6f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:21.153965 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-a509f8e1-f3f2-4df7-84aa-427e484b3a6f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:21.160254 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a509f8e1-f3f2-4df7-84aa-427e484b3a6f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:21.160703 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a509f8e1-f3f2-4df7-84aa-427e484b3a6f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:21.161473 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a509f8e1-f3f2-4df7-84aa-427e484b3a6f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:21.161903 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a509f8e1-f3f2-4df7-84aa-427e484b3a6f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:21.230331 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-05d77eaf-aa13-455d-b3fb-9434deeb4d7c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:21.230935 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-05d77eaf-aa13-455d-b3fb-9434deeb4d7c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:21.236897 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-05d77eaf-aa13-455d-b3fb-9434deeb4d7c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:21.237464 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-05d77eaf-aa13-455d-b3fb-9434deeb4d7c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:21.238503 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-05d77eaf-aa13-455d-b3fb-9434deeb4d7c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:21.239151 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-05d77eaf-aa13-455d-b3fb-9434deeb4d7c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:21.307496 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-a509f8e1-f3f2-4df7-84aa-427e484b3a6f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:21.315773 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-a509f8e1-f3f2-4df7-84aa-427e484b3a6f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:21.317274 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-a509f8e1-f3f2-4df7-84aa-427e484b3a6f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:21.318445 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-a509f8e1-f3f2-4df7-84aa-427e484b3a6f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.168598 Feb 08 16:42:21.319354 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 74/152] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:21 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:21.338408 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e3f33544-854c-4c49-8d2d-29eba7b7e886 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:21.339016 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e3f33544-854c-4c49-8d2d-29eba7b7e886 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:21.345521 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e3f33544-854c-4c49-8d2d-29eba7b7e886 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:21.346037 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e3f33544-854c-4c49-8d2d-29eba7b7e886 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:21.346975 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e3f33544-854c-4c49-8d2d-29eba7b7e886 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:21.347558 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e3f33544-854c-4c49-8d2d-29eba7b7e886 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:21.389510 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-05d77eaf-aa13-455d-b3fb-9434deeb4d7c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:21.397688 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-05d77eaf-aa13-455d-b3fb-9434deeb4d7c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.171793 Feb 08 16:42:21.398312 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 79/153] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:21 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:21.498903 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e3f33544-854c-4c49-8d2d-29eba7b7e886 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:21.507044 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e3f33544-854c-4c49-8d2d-29eba7b7e886 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.172511 Feb 08 16:42:21.508130 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 75/154] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:21 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:42:21.869700 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-fba5ea99-6c0a-41a5-99ef-fe78d731e890 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:21.870467 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-fba5ea99-6c0a-41a5-99ef-fe78d731e890 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:21.876884 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fba5ea99-6c0a-41a5-99ef-fe78d731e890 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:21.877426 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fba5ea99-6c0a-41a5-99ef-fe78d731e890 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:21.878206 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fba5ea99-6c0a-41a5-99ef-fe78d731e890 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:21.878663 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fba5ea99-6c0a-41a5-99ef-fe78d731e890 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:22.059633 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-fba5ea99-6c0a-41a5-99ef-fe78d731e890 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:22.069257 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-fba5ea99-6c0a-41a5-99ef-fe78d731e890 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.203392 Feb 08 16:42:22.072245 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 80/155] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:21 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:22.122824 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-1b235cae-6402-415f-a43c-f82ee09894b4 req-8a3ee83f-25d0-49a3-bade-341f4d14ef4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ba1bca6-d50c-4032-809e-46b9ecbbf304", "name": "network-vif-plugged", "status": "completed", "tag": "8ada1591-1e3d-4284-b7ae-9c7a774e81b8"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:42:22.124443 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:42:22.124443 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:42:22.142091 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-1b235cae-6402-415f-a43c-f82ee09894b4 req-8a3ee83f-25d0-49a3-bade-341f4d14ef4b service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:22.142790 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-1b235cae-6402-415f-a43c-f82ee09894b4 req-8a3ee83f-25d0-49a3-bade-341f4d14ef4b service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:22.156026 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-1b235cae-6402-415f-a43c-f82ee09894b4 req-8a3ee83f-25d0-49a3-bade-341f4d14ef4b service nova] Creating event network-vif-plugged:8ada1591-1e3d-4284-b7ae-9c7a774e81b8 for instance 4ba1bca6-d50c-4032-809e-46b9ecbbf304 on hv-cinder-82786 Feb 08 16:42:22.161338 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-1b235cae-6402-415f-a43c-f82ee09894b4 req-8a3ee83f-25d0-49a3-bade-341f4d14ef4b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127949 Feb 08 16:42:22.161956 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 76/156] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:42:22.336863 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-bda34c28-50fd-458c-98c5-b752938727b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:22.337474 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-bda34c28-50fd-458c-98c5-b752938727b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:22.343713 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bda34c28-50fd-458c-98c5-b752938727b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:22.344215 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bda34c28-50fd-458c-98c5-b752938727b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:22.345045 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bda34c28-50fd-458c-98c5-b752938727b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:22.345496 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bda34c28-50fd-458c-98c5-b752938727b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:22.415351 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-992cfcf2-4c37-4d67-b639-0bf7715fecf3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:22.416284 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-992cfcf2-4c37-4d67-b639-0bf7715fecf3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:22.423702 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-992cfcf2-4c37-4d67-b639-0bf7715fecf3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:22.424477 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-992cfcf2-4c37-4d67-b639-0bf7715fecf3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:22.425283 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-992cfcf2-4c37-4d67-b639-0bf7715fecf3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:22.425723 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-992cfcf2-4c37-4d67-b639-0bf7715fecf3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:22.485654 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-bda34c28-50fd-458c-98c5-b752938727b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:22.494301 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-bda34c28-50fd-458c-98c5-b752938727b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:22.495837 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-bda34c28-50fd-458c-98c5-b752938727b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:22.496955 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-bda34c28-50fd-458c-98c5-b752938727b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.164043 Feb 08 16:42:22.497641 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 81/157] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:22 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:22.524005 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-58f6ebb9-16f5-4d82-8e9f-bf688e2c4efd tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:22.524625 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-58f6ebb9-16f5-4d82-8e9f-bf688e2c4efd tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:22.531605 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-58f6ebb9-16f5-4d82-8e9f-bf688e2c4efd tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:22.532197 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-58f6ebb9-16f5-4d82-8e9f-bf688e2c4efd tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:22.533194 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-58f6ebb9-16f5-4d82-8e9f-bf688e2c4efd tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:22.533751 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-58f6ebb9-16f5-4d82-8e9f-bf688e2c4efd tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:22.586615 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-992cfcf2-4c37-4d67-b639-0bf7715fecf3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:22.594928 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-992cfcf2-4c37-4d67-b639-0bf7715fecf3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.184307 Feb 08 16:42:22.595494 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 77/158] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:22 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:42:22.685984 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-58f6ebb9-16f5-4d82-8e9f-bf688e2c4efd tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:22.698522 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-58f6ebb9-16f5-4d82-8e9f-bf688e2c4efd tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.177989 Feb 08 16:42:22.703783 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 82/159] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:22 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:42:23.086308 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d23d4c85-fa28-4a35-a3c4-fbf3e50bb114 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:23.086910 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-d23d4c85-fa28-4a35-a3c4-fbf3e50bb114 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:23.093050 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d23d4c85-fa28-4a35-a3c4-fbf3e50bb114 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:23.093552 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d23d4c85-fa28-4a35-a3c4-fbf3e50bb114 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:23.094535 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d23d4c85-fa28-4a35-a3c4-fbf3e50bb114 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:23.094994 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d23d4c85-fa28-4a35-a3c4-fbf3e50bb114 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:23.234881 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d23d4c85-fa28-4a35-a3c4-fbf3e50bb114 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:23.243245 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d23d4c85-fa28-4a35-a3c4-fbf3e50bb114 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.160668 Feb 08 16:42:23.244234 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 78/160] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:23 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:23.515466 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-abf4f008-c848-42a0-ae8e-23c5555321f1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:23.516017 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-abf4f008-c848-42a0-ae8e-23c5555321f1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:23.521806 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-abf4f008-c848-42a0-ae8e-23c5555321f1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:23.522257 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-abf4f008-c848-42a0-ae8e-23c5555321f1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:23.523466 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-abf4f008-c848-42a0-ae8e-23c5555321f1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:23.523950 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-abf4f008-c848-42a0-ae8e-23c5555321f1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:23.611063 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-6e6df9b1-6bf7-44c2-a0ef-49c7a7c4aaf4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:23.611674 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-6e6df9b1-6bf7-44c2-a0ef-49c7a7c4aaf4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:23.619515 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6e6df9b1-6bf7-44c2-a0ef-49c7a7c4aaf4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:23.620384 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6e6df9b1-6bf7-44c2-a0ef-49c7a7c4aaf4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:23.621845 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6e6df9b1-6bf7-44c2-a0ef-49c7a7c4aaf4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:23.622644 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6e6df9b1-6bf7-44c2-a0ef-49c7a7c4aaf4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:23.660828 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-abf4f008-c848-42a0-ae8e-23c5555321f1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:23.669544 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-abf4f008-c848-42a0-ae8e-23c5555321f1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:23.671024 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-abf4f008-c848-42a0-ae8e-23c5555321f1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:23.672141 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-abf4f008-c848-42a0-ae8e-23c5555321f1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.160431 Feb 08 16:42:23.672697 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 83/161] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:23 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:23.715735 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-ca4c3955-2f3a-46d8-8746-16b1881a69d8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:23.716371 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-ca4c3955-2f3a-46d8-8746-16b1881a69d8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:23.722344 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ca4c3955-2f3a-46d8-8746-16b1881a69d8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:23.722799 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ca4c3955-2f3a-46d8-8746-16b1881a69d8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:23.723580 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ca4c3955-2f3a-46d8-8746-16b1881a69d8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:23.724044 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ca4c3955-2f3a-46d8-8746-16b1881a69d8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:23.760400 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-6e6df9b1-6bf7-44c2-a0ef-49c7a7c4aaf4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:23.767692 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-6e6df9b1-6bf7-44c2-a0ef-49c7a7c4aaf4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.160115 Feb 08 16:42:23.768221 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 79/162] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:23 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:42:23.857233 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ca4c3955-2f3a-46d8-8746-16b1881a69d8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:23.864530 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-ca4c3955-2f3a-46d8-8746-16b1881a69d8 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.152441 Feb 08 16:42:23.865099 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 84/163] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:23 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:42:24.178640 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-a6cf4764-9fdd-4977-b308-63bd6c0055f8 req-a5369a9b-3fb8-4490-b941-5bb99eac0905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b82748-ebae-4771-b414-3feb285df38d", "name": "network-vif-plugged", "status": "completed", "tag": "c74e45fa-8736-4935-9ded-fac78de32cfe"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:42:24.180850 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:42:24.180850 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:42:24.188048 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-a6cf4764-9fdd-4977-b308-63bd6c0055f8 req-a5369a9b-3fb8-4490-b941-5bb99eac0905 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:24.188557 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-a6cf4764-9fdd-4977-b308-63bd6c0055f8 req-a5369a9b-3fb8-4490-b941-5bb99eac0905 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:24.199658 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-a6cf4764-9fdd-4977-b308-63bd6c0055f8 req-a5369a9b-3fb8-4490-b941-5bb99eac0905 service nova] Creating event network-vif-plugged:c74e45fa-8736-4935-9ded-fac78de32cfe for instance 46b82748-ebae-4771-b414-3feb285df38d on hv-cinder-82786 Feb 08 16:42:24.204654 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-a6cf4764-9fdd-4977-b308-63bd6c0055f8 req-a5369a9b-3fb8-4490-b941-5bb99eac0905 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029864 Feb 08 16:42:24.205269 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 80/164] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:42:24.258946 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-5db7a4e2-acd0-457d-a528-5371ced90f49 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:24.259561 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-5db7a4e2-acd0-457d-a528-5371ced90f49 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:24.265378 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5db7a4e2-acd0-457d-a528-5371ced90f49 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:24.265819 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5db7a4e2-acd0-457d-a528-5371ced90f49 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:24.266588 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5db7a4e2-acd0-457d-a528-5371ced90f49 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:24.267016 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5db7a4e2-acd0-457d-a528-5371ced90f49 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:24.416595 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-5db7a4e2-acd0-457d-a528-5371ced90f49 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:24.440780 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-5db7a4e2-acd0-457d-a528-5371ced90f49 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.185434 Feb 08 16:42:24.441624 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 85/165] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:24 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:24.691815 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-440ca839-16a7-4460-9df5-36f96e183daa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:24.692521 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-440ca839-16a7-4460-9df5-36f96e183daa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:24.698609 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-440ca839-16a7-4460-9df5-36f96e183daa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:24.699057 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-440ca839-16a7-4460-9df5-36f96e183daa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:24.699859 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-440ca839-16a7-4460-9df5-36f96e183daa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:24.700302 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-440ca839-16a7-4460-9df5-36f96e183daa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:24.784752 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-02494ede-21b4-4521-b403-6047d9146f73 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:24.785360 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-02494ede-21b4-4521-b403-6047d9146f73 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:24.792330 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-02494ede-21b4-4521-b403-6047d9146f73 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:24.792785 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-02494ede-21b4-4521-b403-6047d9146f73 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:24.793570 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-02494ede-21b4-4521-b403-6047d9146f73 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:24.794006 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-02494ede-21b4-4521-b403-6047d9146f73 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:24.842179 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-440ca839-16a7-4460-9df5-36f96e183daa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:24.849831 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-440ca839-16a7-4460-9df5-36f96e183daa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:24.851492 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-440ca839-16a7-4460-9df5-36f96e183daa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:24.852605 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-440ca839-16a7-4460-9df5-36f96e183daa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.164845 Feb 08 16:42:24.853167 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 81/166] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:24 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:24.881411 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-7b356cda-2960-4274-973c-037bdd8c8152 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:24.882532 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7b356cda-2960-4274-973c-037bdd8c8152 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:24.888426 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7b356cda-2960-4274-973c-037bdd8c8152 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:24.888870 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7b356cda-2960-4274-973c-037bdd8c8152 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:24.889638 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7b356cda-2960-4274-973c-037bdd8c8152 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:24.890074 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7b356cda-2960-4274-973c-037bdd8c8152 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:24.930936 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-02494ede-21b4-4521-b403-6047d9146f73 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:24.938346 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-02494ede-21b4-4521-b403-6047d9146f73 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.157246 Feb 08 16:42:24.938919 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 86/167] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:24 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:42:25.021709 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7b356cda-2960-4274-973c-037bdd8c8152 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:25.029535 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-7b356cda-2960-4274-973c-037bdd8c8152 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.152035 Feb 08 16:42:25.030099 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 82/168] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:24 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:42:25.460715 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-84ed9690-0336-4264-b75c-414c5811ef69 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:25.461324 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-84ed9690-0336-4264-b75c-414c5811ef69 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:25.467349 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-84ed9690-0336-4264-b75c-414c5811ef69 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:25.467840 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-84ed9690-0336-4264-b75c-414c5811ef69 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:25.468611 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-84ed9690-0336-4264-b75c-414c5811ef69 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:25.469051 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-84ed9690-0336-4264-b75c-414c5811ef69 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:25.598261 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-84ed9690-0336-4264-b75c-414c5811ef69 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:25.606616 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-84ed9690-0336-4264-b75c-414c5811ef69 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.148935 Feb 08 16:42:25.606616 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 87/169] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:25 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:25.871113 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-cd4ea93d-6065-4dcb-ad6c-9fa5f6990062 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:25.871713 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-cd4ea93d-6065-4dcb-ad6c-9fa5f6990062 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:25.877648 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cd4ea93d-6065-4dcb-ad6c-9fa5f6990062 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:25.878089 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cd4ea93d-6065-4dcb-ad6c-9fa5f6990062 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:25.878850 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cd4ea93d-6065-4dcb-ad6c-9fa5f6990062 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:25.879275 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cd4ea93d-6065-4dcb-ad6c-9fa5f6990062 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:25.958438 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-0a544c0e-7671-43d1-89ce-e3ded431e77b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:25.960810 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-0a544c0e-7671-43d1-89ce-e3ded431e77b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:25.967377 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0a544c0e-7671-43d1-89ce-e3ded431e77b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:25.968103 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0a544c0e-7671-43d1-89ce-e3ded431e77b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:25.969109 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0a544c0e-7671-43d1-89ce-e3ded431e77b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:25.969543 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0a544c0e-7671-43d1-89ce-e3ded431e77b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:26.095858 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-cd4ea93d-6065-4dcb-ad6c-9fa5f6990062 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:26.104213 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-cd4ea93d-6065-4dcb-ad6c-9fa5f6990062 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:26.105694 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-cd4ea93d-6065-4dcb-ad6c-9fa5f6990062 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:26.106785 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-cd4ea93d-6065-4dcb-ad6c-9fa5f6990062 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.239351 Feb 08 16:42:26.107344 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 83/170] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:25 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:26.111833 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-45715457-2e70-4bfd-9c43-763c87fbc985 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:26.112431 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-45715457-2e70-4bfd-9c43-763c87fbc985 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:26.118928 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-45715457-2e70-4bfd-9c43-763c87fbc985 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:26.119369 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-45715457-2e70-4bfd-9c43-763c87fbc985 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:26.120199 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-45715457-2e70-4bfd-9c43-763c87fbc985 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:26.120626 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-45715457-2e70-4bfd-9c43-763c87fbc985 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:26.139465 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-0a544c0e-7671-43d1-89ce-e3ded431e77b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:26.146628 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-0a544c0e-7671-43d1-89ce-e3ded431e77b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.195275 Feb 08 16:42:26.147185 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 88/171] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:25 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:26.249565 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-45715457-2e70-4bfd-9c43-763c87fbc985 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:26.256504 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-45715457-2e70-4bfd-9c43-763c87fbc985 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.147672 Feb 08 16:42:26.257277 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 84/172] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:26 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:26.622334 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-75afa5cd-711b-4ad6-9797-39cfc2a9cdad tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:26.622937 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-75afa5cd-711b-4ad6-9797-39cfc2a9cdad tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:26.628779 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-75afa5cd-711b-4ad6-9797-39cfc2a9cdad tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:26.629245 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-75afa5cd-711b-4ad6-9797-39cfc2a9cdad tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:26.630055 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-75afa5cd-711b-4ad6-9797-39cfc2a9cdad tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:26.630566 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-75afa5cd-711b-4ad6-9797-39cfc2a9cdad tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:26.771419 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-75afa5cd-711b-4ad6-9797-39cfc2a9cdad tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:26.778785 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-75afa5cd-711b-4ad6-9797-39cfc2a9cdad tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.160269 Feb 08 16:42:26.779357 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 89/173] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:26 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:27.124424 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-9d34e60c-e601-4af5-ae15-e1abff6a2900 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:27.125038 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-9d34e60c-e601-4af5-ae15-e1abff6a2900 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:27.131196 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9d34e60c-e601-4af5-ae15-e1abff6a2900 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:27.132730 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9d34e60c-e601-4af5-ae15-e1abff6a2900 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:27.133551 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9d34e60c-e601-4af5-ae15-e1abff6a2900 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:27.134023 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9d34e60c-e601-4af5-ae15-e1abff6a2900 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:27.165387 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-024a0a94-4a07-4ac3-ad17-a6c3db2887fb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:27.166032 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-024a0a94-4a07-4ac3-ad17-a6c3db2887fb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:27.172335 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-024a0a94-4a07-4ac3-ad17-a6c3db2887fb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:27.172777 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-024a0a94-4a07-4ac3-ad17-a6c3db2887fb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:27.173551 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-024a0a94-4a07-4ac3-ad17-a6c3db2887fb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:27.174138 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-024a0a94-4a07-4ac3-ad17-a6c3db2887fb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:27.274648 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-9d34e60c-e601-4af5-ae15-e1abff6a2900 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:27.283155 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-9d34e60c-e601-4af5-ae15-e1abff6a2900 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:27.284698 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-9d34e60c-e601-4af5-ae15-e1abff6a2900 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:27.285861 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-9d34e60c-e601-4af5-ae15-e1abff6a2900 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.165119 Feb 08 16:42:27.286453 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 85/174] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:27 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:27.291448 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-1438bf86-2990-42d7-9eb9-2910c4a114fd tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:27.292657 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-1438bf86-2990-42d7-9eb9-2910c4a114fd tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:27.299713 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1438bf86-2990-42d7-9eb9-2910c4a114fd tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:27.300356 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1438bf86-2990-42d7-9eb9-2910c4a114fd tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:27.301500 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1438bf86-2990-42d7-9eb9-2910c4a114fd tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:27.302103 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1438bf86-2990-42d7-9eb9-2910c4a114fd tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:27.321085 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-024a0a94-4a07-4ac3-ad17-a6c3db2887fb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:27.328580 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-024a0a94-4a07-4ac3-ad17-a6c3db2887fb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.167880 Feb 08 16:42:27.329338 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 90/175] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:27 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:42:27.626662 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-1438bf86-2990-42d7-9eb9-2910c4a114fd tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:27.637102 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-1438bf86-2990-42d7-9eb9-2910c4a114fd tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.349465 Feb 08 16:42:27.637711 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 86/176] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:27 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:27.796820 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-cb396919-e81f-4729-81f8-8117083b44b8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:27.797490 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-cb396919-e81f-4729-81f8-8117083b44b8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:27.805182 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cb396919-e81f-4729-81f8-8117083b44b8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:27.806256 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cb396919-e81f-4729-81f8-8117083b44b8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:27.807234 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cb396919-e81f-4729-81f8-8117083b44b8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:27.807971 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cb396919-e81f-4729-81f8-8117083b44b8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:27.986532 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-cb396919-e81f-4729-81f8-8117083b44b8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:27.998594 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-cb396919-e81f-4729-81f8-8117083b44b8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.205458 Feb 08 16:42:27.998902 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 91/177] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:27 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:28.305167 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-cb0eb8d0-037c-4d0c-8b22-494f21660f47 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:28.306370 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-cb0eb8d0-037c-4d0c-8b22-494f21660f47 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:28.313194 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cb0eb8d0-037c-4d0c-8b22-494f21660f47 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:28.314005 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cb0eb8d0-037c-4d0c-8b22-494f21660f47 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:28.314862 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cb0eb8d0-037c-4d0c-8b22-494f21660f47 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:28.315329 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cb0eb8d0-037c-4d0c-8b22-494f21660f47 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:28.346836 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-8dc2c337-250a-43ef-a45d-5d5a58a8f56c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:28.348230 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-8dc2c337-250a-43ef-a45d-5d5a58a8f56c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:28.358970 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8dc2c337-250a-43ef-a45d-5d5a58a8f56c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:28.362642 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8dc2c337-250a-43ef-a45d-5d5a58a8f56c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:28.363794 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8dc2c337-250a-43ef-a45d-5d5a58a8f56c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:28.364599 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8dc2c337-250a-43ef-a45d-5d5a58a8f56c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:28.505812 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-cb0eb8d0-037c-4d0c-8b22-494f21660f47 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:28.514672 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-cb0eb8d0-037c-4d0c-8b22-494f21660f47 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:28.516373 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-cb0eb8d0-037c-4d0c-8b22-494f21660f47 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:28.517896 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-cb0eb8d0-037c-4d0c-8b22-494f21660f47 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.217224 Feb 08 16:42:28.518686 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 87/178] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:28 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:28.657091 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-00800559-60b5-487a-8afb-4793f397b508 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:28.658077 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-00800559-60b5-487a-8afb-4793f397b508 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:28.666390 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-00800559-60b5-487a-8afb-4793f397b508 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:28.666977 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-00800559-60b5-487a-8afb-4793f397b508 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:28.668052 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-00800559-60b5-487a-8afb-4793f397b508 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:28.668742 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-00800559-60b5-487a-8afb-4793f397b508 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:28.675482 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-8dc2c337-250a-43ef-a45d-5d5a58a8f56c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:28.693427 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-8dc2c337-250a-43ef-a45d-5d5a58a8f56c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.351176 Feb 08 16:42:28.694588 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 92/179] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:28 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:42:28.880485 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-00800559-60b5-487a-8afb-4793f397b508 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:28.890376 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-00800559-60b5-487a-8afb-4793f397b508 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.237033 Feb 08 16:42:28.890946 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 88/180] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:28 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:29.019179 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-29388575-f74e-4b48-b121-27ade80cdd6a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:29.019179 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-29388575-f74e-4b48-b121-27ade80cdd6a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:29.023545 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-29388575-f74e-4b48-b121-27ade80cdd6a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:29.024316 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-29388575-f74e-4b48-b121-27ade80cdd6a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:29.025261 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-29388575-f74e-4b48-b121-27ade80cdd6a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:29.025702 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-29388575-f74e-4b48-b121-27ade80cdd6a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:29.249611 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-29388575-f74e-4b48-b121-27ade80cdd6a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:29.257888 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-29388575-f74e-4b48-b121-27ade80cdd6a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.245396 Feb 08 16:42:29.258508 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 93/181] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:29 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:29.538934 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d836c48d-98db-4a41-8b00-acf268c2f35f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:29.539543 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-d836c48d-98db-4a41-8b00-acf268c2f35f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:29.545568 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d836c48d-98db-4a41-8b00-acf268c2f35f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:29.546021 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d836c48d-98db-4a41-8b00-acf268c2f35f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:29.546801 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d836c48d-98db-4a41-8b00-acf268c2f35f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:29.547399 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d836c48d-98db-4a41-8b00-acf268c2f35f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:29.710599 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-93dc004f-94bf-4268-baae-3bfb44e12c05 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:29.711933 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-93dc004f-94bf-4268-baae-3bfb44e12c05 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:29.717953 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-93dc004f-94bf-4268-baae-3bfb44e12c05 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:29.718578 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-93dc004f-94bf-4268-baae-3bfb44e12c05 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:29.719666 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-93dc004f-94bf-4268-baae-3bfb44e12c05 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:29.720283 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-93dc004f-94bf-4268-baae-3bfb44e12c05 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:29.720992 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d836c48d-98db-4a41-8b00-acf268c2f35f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:29.730501 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d836c48d-98db-4a41-8b00-acf268c2f35f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:29.732242 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d836c48d-98db-4a41-8b00-acf268c2f35f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:29.733944 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d836c48d-98db-4a41-8b00-acf268c2f35f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.199699 Feb 08 16:42:29.734572 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 89/182] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:29 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:42:29.905600 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-93dc004f-94bf-4268-baae-3bfb44e12c05 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:29.906111 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-6bf0362a-cc37-4010-9bbd-edcb8b3cbdff tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:29.906723 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-6bf0362a-cc37-4010-9bbd-edcb8b3cbdff tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:29.912677 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6bf0362a-cc37-4010-9bbd-edcb8b3cbdff tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:29.912904 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-93dc004f-94bf-4268-baae-3bfb44e12c05 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.206170 Feb 08 16:42:29.913241 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6bf0362a-cc37-4010-9bbd-edcb8b3cbdff tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:29.914193 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6bf0362a-cc37-4010-9bbd-edcb8b3cbdff tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:29.914924 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6bf0362a-cc37-4010-9bbd-edcb8b3cbdff tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:29.922020 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 94/183] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:29 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:42:30.061480 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-6bf0362a-cc37-4010-9bbd-edcb8b3cbdff tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:30.069409 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-6bf0362a-cc37-4010-9bbd-edcb8b3cbdff tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.166874 Feb 08 16:42:30.070442 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 90/184] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:29 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:30.275121 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e9cd0844-496e-4a62-b87d-5663ad913cd2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:30.275720 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e9cd0844-496e-4a62-b87d-5663ad913cd2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:30.281755 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e9cd0844-496e-4a62-b87d-5663ad913cd2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:30.282384 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e9cd0844-496e-4a62-b87d-5663ad913cd2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:30.283154 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e9cd0844-496e-4a62-b87d-5663ad913cd2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:30.283580 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e9cd0844-496e-4a62-b87d-5663ad913cd2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:30.433893 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e9cd0844-496e-4a62-b87d-5663ad913cd2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:30.445124 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e9cd0844-496e-4a62-b87d-5663ad913cd2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.173805 Feb 08 16:42:30.445715 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 95/185] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:30 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:30.762695 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-380e0600-2d6a-4195-bfa4-1c295237429c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:30.764222 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-380e0600-2d6a-4195-bfa4-1c295237429c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:30.770811 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-380e0600-2d6a-4195-bfa4-1c295237429c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:30.771530 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-380e0600-2d6a-4195-bfa4-1c295237429c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:30.773188 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-380e0600-2d6a-4195-bfa4-1c295237429c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:30.774010 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-380e0600-2d6a-4195-bfa4-1c295237429c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:30.928983 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-d8c1c819-0e0c-424b-a986-2e920bcb9dac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:30.930404 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-d8c1c819-0e0c-424b-a986-2e920bcb9dac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:30.938742 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d8c1c819-0e0c-424b-a986-2e920bcb9dac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:30.939380 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d8c1c819-0e0c-424b-a986-2e920bcb9dac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:30.940466 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d8c1c819-0e0c-424b-a986-2e920bcb9dac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:30.941122 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d8c1c819-0e0c-424b-a986-2e920bcb9dac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:30.950402 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-380e0600-2d6a-4195-bfa4-1c295237429c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:30.958953 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-380e0600-2d6a-4195-bfa4-1c295237429c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:30.961083 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-380e0600-2d6a-4195-bfa4-1c295237429c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:30.962190 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-380e0600-2d6a-4195-bfa4-1c295237429c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.204555 Feb 08 16:42:30.962750 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 91/186] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:30 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:31.085812 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-70738fe8-99c7-4de5-9200-b9129f9be24d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:31.087039 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-70738fe8-99c7-4de5-9200-b9129f9be24d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:31.090025 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-d8c1c819-0e0c-424b-a986-2e920bcb9dac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:31.093856 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-70738fe8-99c7-4de5-9200-b9129f9be24d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:31.094115 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-70738fe8-99c7-4de5-9200-b9129f9be24d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:31.094705 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-70738fe8-99c7-4de5-9200-b9129f9be24d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:31.095188 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-70738fe8-99c7-4de5-9200-b9129f9be24d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:31.097872 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-d8c1c819-0e0c-424b-a986-2e920bcb9dac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.172445 Feb 08 16:42:31.099175 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 96/187] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:30 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:31.241507 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-70738fe8-99c7-4de5-9200-b9129f9be24d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:31.249046 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-70738fe8-99c7-4de5-9200-b9129f9be24d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.167584 Feb 08 16:42:31.249553 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 92/188] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:31 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:42:31.461933 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-d6ce6c66-3fbd-48cc-af88-5356bf5bab4f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:31.462541 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-d6ce6c66-3fbd-48cc-af88-5356bf5bab4f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:31.468843 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d6ce6c66-3fbd-48cc-af88-5356bf5bab4f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:31.469878 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d6ce6c66-3fbd-48cc-af88-5356bf5bab4f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:31.471138 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d6ce6c66-3fbd-48cc-af88-5356bf5bab4f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:31.471808 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d6ce6c66-3fbd-48cc-af88-5356bf5bab4f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:31.675175 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-d6ce6c66-3fbd-48cc-af88-5356bf5bab4f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:31.683214 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-d6ce6c66-3fbd-48cc-af88-5356bf5bab4f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.225262 Feb 08 16:42:31.683804 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 97/189] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:31 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:31.979989 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-45a916b5-1615-40ae-870d-9ff09152de0a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:31.980601 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-45a916b5-1615-40ae-870d-9ff09152de0a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:31.986336 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-45a916b5-1615-40ae-870d-9ff09152de0a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:31.987036 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-45a916b5-1615-40ae-870d-9ff09152de0a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:31.987620 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-45a916b5-1615-40ae-870d-9ff09152de0a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:31.988063 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-45a916b5-1615-40ae-870d-9ff09152de0a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:32.115354 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-7b243940-6f43-4321-b316-a6aa6bbf403b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:32.116485 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-7b243940-6f43-4321-b316-a6aa6bbf403b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:32.122821 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7b243940-6f43-4321-b316-a6aa6bbf403b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:32.123355 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7b243940-6f43-4321-b316-a6aa6bbf403b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:32.124160 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7b243940-6f43-4321-b316-a6aa6bbf403b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:32.124597 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7b243940-6f43-4321-b316-a6aa6bbf403b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:32.217541 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-45a916b5-1615-40ae-870d-9ff09152de0a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:32.228429 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-45a916b5-1615-40ae-870d-9ff09152de0a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:32.230209 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-45a916b5-1615-40ae-870d-9ff09152de0a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:32.231503 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-45a916b5-1615-40ae-870d-9ff09152de0a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.254988 Feb 08 16:42:32.231921 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 93/190] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:31 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:32.268768 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-00de8a13-9d46-45eb-9a0e-716e91a8d7bb tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:32.269708 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-00de8a13-9d46-45eb-9a0e-716e91a8d7bb tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:32.276826 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-00de8a13-9d46-45eb-9a0e-716e91a8d7bb tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:32.277285 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-00de8a13-9d46-45eb-9a0e-716e91a8d7bb tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:32.278075 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-00de8a13-9d46-45eb-9a0e-716e91a8d7bb tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:32.278514 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-00de8a13-9d46-45eb-9a0e-716e91a8d7bb tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:32.287586 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-7b243940-6f43-4321-b316-a6aa6bbf403b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:32.295469 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-7b243940-6f43-4321-b316-a6aa6bbf403b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.184211 Feb 08 16:42:32.296092 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 98/191] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:32 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:32.440431 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-00de8a13-9d46-45eb-9a0e-716e91a8d7bb tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:32.447856 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-00de8a13-9d46-45eb-9a0e-716e91a8d7bb tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.185152 Feb 08 16:42:32.448412 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 94/192] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:32 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:42:32.699047 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b4ef7d8d-7eb2-45ad-91ae-a463fa302e92 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:32.699654 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b4ef7d8d-7eb2-45ad-91ae-a463fa302e92 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:32.706052 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b4ef7d8d-7eb2-45ad-91ae-a463fa302e92 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:32.706502 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b4ef7d8d-7eb2-45ad-91ae-a463fa302e92 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:32.707277 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b4ef7d8d-7eb2-45ad-91ae-a463fa302e92 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:32.707709 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b4ef7d8d-7eb2-45ad-91ae-a463fa302e92 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:32.851049 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b4ef7d8d-7eb2-45ad-91ae-a463fa302e92 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:32.859133 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b4ef7d8d-7eb2-45ad-91ae-a463fa302e92 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.163616 Feb 08 16:42:32.859908 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 99/193] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:32 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:33.001359 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-573dc819-081c-426f-bebf-7fe1ee5541de req-519c1b41-a86d-4012-a9c5-24c830fa87c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136b1df1-a111-4a7b-8a8d-5e095dadc764", "name": "network-vif-plugged", "status": "completed", "tag": "f72c3bbd-5f67-4f43-a4c1-f7f6cc240f10"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:42:33.003894 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:42:33.003894 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:42:33.025002 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-573dc819-081c-426f-bebf-7fe1ee5541de req-519c1b41-a86d-4012-a9c5-24c830fa87c8 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:33.025341 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-573dc819-081c-426f-bebf-7fe1ee5541de req-519c1b41-a86d-4012-a9c5-24c830fa87c8 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:33.038312 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-573dc819-081c-426f-bebf-7fe1ee5541de req-519c1b41-a86d-4012-a9c5-24c830fa87c8 service nova] Creating event network-vif-plugged:f72c3bbd-5f67-4f43-a4c1-f7f6cc240f10 for instance 136b1df1-a111-4a7b-8a8d-5e095dadc764 on hv-cinder-82786 Feb 08 16:42:33.043914 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-573dc819-081c-426f-bebf-7fe1ee5541de req-519c1b41-a86d-4012-a9c5-24c830fa87c8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046250 Feb 08 16:42:33.044656 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 95/194] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:42:33.249222 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-2f328e8e-45ab-48dd-bdc3-15939ff4aeeb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:33.249828 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-2f328e8e-45ab-48dd-bdc3-15939ff4aeeb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:33.257135 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2f328e8e-45ab-48dd-bdc3-15939ff4aeeb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:33.257581 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2f328e8e-45ab-48dd-bdc3-15939ff4aeeb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:33.258364 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2f328e8e-45ab-48dd-bdc3-15939ff4aeeb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:33.258797 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2f328e8e-45ab-48dd-bdc3-15939ff4aeeb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:33.313115 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-5ee66db4-1d4c-4e54-8c2b-bc474bc6d810 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:33.313923 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-5ee66db4-1d4c-4e54-8c2b-bc474bc6d810 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:33.320614 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5ee66db4-1d4c-4e54-8c2b-bc474bc6d810 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:33.321316 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5ee66db4-1d4c-4e54-8c2b-bc474bc6d810 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:33.322431 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5ee66db4-1d4c-4e54-8c2b-bc474bc6d810 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:33.323025 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5ee66db4-1d4c-4e54-8c2b-bc474bc6d810 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:33.435860 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-2f328e8e-45ab-48dd-bdc3-15939ff4aeeb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:33.445860 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-2f328e8e-45ab-48dd-bdc3-15939ff4aeeb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:33.449494 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-2f328e8e-45ab-48dd-bdc3-15939ff4aeeb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:33.451254 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-2f328e8e-45ab-48dd-bdc3-15939ff4aeeb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.205438 Feb 08 16:42:33.452088 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 100/195] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:33 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:33.472266 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-8335f3fa-3a44-4056-b6c4-c83f532348d5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:33.477924 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-8335f3fa-3a44-4056-b6c4-c83f532348d5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:33.488225 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8335f3fa-3a44-4056-b6c4-c83f532348d5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:33.489973 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8335f3fa-3a44-4056-b6c4-c83f532348d5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:33.492093 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8335f3fa-3a44-4056-b6c4-c83f532348d5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:33.492734 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8335f3fa-3a44-4056-b6c4-c83f532348d5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:33.691635 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-8335f3fa-3a44-4056-b6c4-c83f532348d5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:33.699841 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-8335f3fa-3a44-4056-b6c4-c83f532348d5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1315 microversion: 2.1 time: 0.238239 Feb 08 16:42:33.700791 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 101/196] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:33 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:33.710484 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-5ee66db4-1d4c-4e54-8c2b-bc474bc6d810 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:33.718698 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-5ee66db4-1d4c-4e54-8c2b-bc474bc6d810 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.409455 Feb 08 16:42:33.719654 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 96/197] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:33 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:33.876043 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-85074e79-5cd4-4556-8d94-693af2cd6393 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:33.876629 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-85074e79-5cd4-4556-8d94-693af2cd6393 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:33.883091 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-85074e79-5cd4-4556-8d94-693af2cd6393 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:33.883577 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-85074e79-5cd4-4556-8d94-693af2cd6393 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:33.884437 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-85074e79-5cd4-4556-8d94-693af2cd6393 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:33.884896 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-85074e79-5cd4-4556-8d94-693af2cd6393 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:34.032325 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-85074e79-5cd4-4556-8d94-693af2cd6393 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:34.040314 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-85074e79-5cd4-4556-8d94-693af2cd6393 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.168369 Feb 08 16:42:34.041113 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 102/198] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:33 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:34.470346 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-f37dab3c-233d-4002-af2a-dbfee6abdfbd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:34.470962 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-f37dab3c-233d-4002-af2a-dbfee6abdfbd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:34.477229 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f37dab3c-233d-4002-af2a-dbfee6abdfbd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:34.477677 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f37dab3c-233d-4002-af2a-dbfee6abdfbd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:34.478459 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f37dab3c-233d-4002-af2a-dbfee6abdfbd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:34.478896 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f37dab3c-233d-4002-af2a-dbfee6abdfbd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:34.619643 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f37dab3c-233d-4002-af2a-dbfee6abdfbd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:34.627930 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f37dab3c-233d-4002-af2a-dbfee6abdfbd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:34.629378 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f37dab3c-233d-4002-af2a-dbfee6abdfbd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:34.630741 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-f37dab3c-233d-4002-af2a-dbfee6abdfbd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.164028 Feb 08 16:42:34.631829 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 97/199] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:34 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:34.716506 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-644890d6-ebb3-4a04-9aac-137f27b2b9e3 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:34.717262 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-644890d6-ebb3-4a04-9aac-137f27b2b9e3 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:34.723433 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-644890d6-ebb3-4a04-9aac-137f27b2b9e3 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:34.723910 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-644890d6-ebb3-4a04-9aac-137f27b2b9e3 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:34.724759 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-644890d6-ebb3-4a04-9aac-137f27b2b9e3 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:34.725843 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-644890d6-ebb3-4a04-9aac-137f27b2b9e3 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:34.736764 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-eab75af0-24bb-4348-a150-e6fa750cd19f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:34.737902 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-eab75af0-24bb-4348-a150-e6fa750cd19f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:34.746089 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-eab75af0-24bb-4348-a150-e6fa750cd19f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:34.746780 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-eab75af0-24bb-4348-a150-e6fa750cd19f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:34.747626 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-eab75af0-24bb-4348-a150-e6fa750cd19f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:34.748093 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-eab75af0-24bb-4348-a150-e6fa750cd19f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:34.889363 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-644890d6-ebb3-4a04-9aac-137f27b2b9e3 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:34.898908 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-644890d6-ebb3-4a04-9aac-137f27b2b9e3 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1502 microversion: 2.1 time: 0.186102 Feb 08 16:42:34.899588 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 103/200] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:34 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1502 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:34.910804 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-eab75af0-24bb-4348-a150-e6fa750cd19f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:34.920214 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-eab75af0-24bb-4348-a150-e6fa750cd19f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.187492 Feb 08 16:42:34.920989 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 98/201] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:34 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:35.061450 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-33d4b27e-6428-4dc8-8667-35ba085cb420 req-ddd7ea6c-8faa-45ee-8324-18e35ae736d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3491de9b-89ec-4861-b97f-f32158e658cc", "name": "network-vif-plugged", "status": "completed", "tag": "34c8d083-5aff-4e0c-ab35-54f6088f7587"}, {"server_uuid": "da00c476-8246-413e-889c-d22fe63e2ef8", "name": "network-vif-plugged", "status": "completed", "tag": "dc601835-5363-4bdf-9b05-9e711057cbd2"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:42:35.063503 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:42:35.063503 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:42:35.066363 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-52bdced7-b86f-4dc9-955c-3d027452a971 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:35.067001 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-52bdced7-b86f-4dc9-955c-3d027452a971 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:35.074368 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-52bdced7-b86f-4dc9-955c-3d027452a971 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:35.074900 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-52bdced7-b86f-4dc9-955c-3d027452a971 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:35.076457 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-52bdced7-b86f-4dc9-955c-3d027452a971 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:35.077270 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-52bdced7-b86f-4dc9-955c-3d027452a971 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:35.077720 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-33d4b27e-6428-4dc8-8667-35ba085cb420 req-ddd7ea6c-8faa-45ee-8324-18e35ae736d2 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:35.078207 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-33d4b27e-6428-4dc8-8667-35ba085cb420 req-ddd7ea6c-8faa-45ee-8324-18e35ae736d2 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:35.096575 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-33d4b27e-6428-4dc8-8667-35ba085cb420 req-ddd7ea6c-8faa-45ee-8324-18e35ae736d2 service nova] Creating event network-vif-plugged:34c8d083-5aff-4e0c-ab35-54f6088f7587 for instance 3491de9b-89ec-4861-b97f-f32158e658cc on hv-cinder-82786 Feb 08 16:42:35.097265 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-33d4b27e-6428-4dc8-8667-35ba085cb420 req-ddd7ea6c-8faa-45ee-8324-18e35ae736d2 service nova] Creating event network-vif-plugged:dc601835-5363-4bdf-9b05-9e711057cbd2 for instance da00c476-8246-413e-889c-d22fe63e2ef8 on hv-cinder-82786 Feb 08 16:42:35.106229 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-33d4b27e-6428-4dc8-8667-35ba085cb420 req-ddd7ea6c-8faa-45ee-8324-18e35ae736d2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049067 Feb 08 16:42:35.107049 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 99/202] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:42:35.239392 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-52bdced7-b86f-4dc9-955c-3d027452a971 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:35.247327 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-52bdced7-b86f-4dc9-955c-3d027452a971 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.194093 Feb 08 16:42:35.247913 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 104/203] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:35 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:35.650763 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-134dd2f0-09b6-498f-983f-f795e745e06b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:35.651445 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-134dd2f0-09b6-498f-983f-f795e745e06b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:35.657544 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-134dd2f0-09b6-498f-983f-f795e745e06b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:35.657991 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-134dd2f0-09b6-498f-983f-f795e745e06b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:35.658750 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-134dd2f0-09b6-498f-983f-f795e745e06b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:35.659178 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-134dd2f0-09b6-498f-983f-f795e745e06b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:35.798667 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-134dd2f0-09b6-498f-983f-f795e745e06b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:35.806378 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-134dd2f0-09b6-498f-983f-f795e745e06b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:35.807878 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-134dd2f0-09b6-498f-983f-f795e745e06b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:35.808958 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-134dd2f0-09b6-498f-983f-f795e745e06b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.162241 Feb 08 16:42:35.809508 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 100/204] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:35 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:35.937951 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-a859d5b5-1ede-4e7a-9901-52406f6ad272 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:35.938520 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-a859d5b5-1ede-4e7a-9901-52406f6ad272 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:35.944449 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a859d5b5-1ede-4e7a-9901-52406f6ad272 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:35.944892 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a859d5b5-1ede-4e7a-9901-52406f6ad272 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:35.945663 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a859d5b5-1ede-4e7a-9901-52406f6ad272 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:35.946096 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a859d5b5-1ede-4e7a-9901-52406f6ad272 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:36.080083 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-a859d5b5-1ede-4e7a-9901-52406f6ad272 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:36.087831 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-a859d5b5-1ede-4e7a-9901-52406f6ad272 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.153547 Feb 08 16:42:36.088405 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 105/205] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:35 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:36.269282 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-8d949b2a-5122-4ddc-ad77-f32957a77bc8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:36.269941 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-8d949b2a-5122-4ddc-ad77-f32957a77bc8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:36.275975 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8d949b2a-5122-4ddc-ad77-f32957a77bc8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:36.276430 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8d949b2a-5122-4ddc-ad77-f32957a77bc8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:36.277215 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8d949b2a-5122-4ddc-ad77-f32957a77bc8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:36.277651 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8d949b2a-5122-4ddc-ad77-f32957a77bc8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:36.410058 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-8d949b2a-5122-4ddc-ad77-f32957a77bc8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:36.417788 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-8d949b2a-5122-4ddc-ad77-f32957a77bc8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.156317 Feb 08 16:42:36.418348 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 101/206] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:36 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:36.825944 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-56eb81e9-097b-46eb-855c-f5b05beb49b2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:36.826554 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-56eb81e9-097b-46eb-855c-f5b05beb49b2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:36.832503 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-56eb81e9-097b-46eb-855c-f5b05beb49b2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:36.832953 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-56eb81e9-097b-46eb-855c-f5b05beb49b2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:36.833733 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-56eb81e9-097b-46eb-855c-f5b05beb49b2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:36.834166 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-56eb81e9-097b-46eb-855c-f5b05beb49b2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:36.964790 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-56eb81e9-097b-46eb-855c-f5b05beb49b2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:36.972419 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-56eb81e9-097b-46eb-855c-f5b05beb49b2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:36.973914 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-56eb81e9-097b-46eb-855c-f5b05beb49b2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:36.975155 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-56eb81e9-097b-46eb-855c-f5b05beb49b2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.152840 Feb 08 16:42:36.975715 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 106/207] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:36 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:37.104851 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ca4cf18f-9537-49e9-8267-3ddca83ad872 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:37.105367 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-ca4cf18f-9537-49e9-8267-3ddca83ad872 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:37.112056 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ca4cf18f-9537-49e9-8267-3ddca83ad872 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:37.112606 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ca4cf18f-9537-49e9-8267-3ddca83ad872 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:37.113416 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ca4cf18f-9537-49e9-8267-3ddca83ad872 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:37.113858 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ca4cf18f-9537-49e9-8267-3ddca83ad872 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:37.251687 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ca4cf18f-9537-49e9-8267-3ddca83ad872 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:37.260197 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-ca4cf18f-9537-49e9-8267-3ddca83ad872 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.160168 Feb 08 16:42:37.260767 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 102/208] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:37 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:37.434960 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b5601436-3e80-4b54-90a4-23a3a5dca554 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:37.435570 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b5601436-3e80-4b54-90a4-23a3a5dca554 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:37.441643 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b5601436-3e80-4b54-90a4-23a3a5dca554 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:37.442144 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b5601436-3e80-4b54-90a4-23a3a5dca554 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:37.442927 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b5601436-3e80-4b54-90a4-23a3a5dca554 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:37.443362 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b5601436-3e80-4b54-90a4-23a3a5dca554 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:37.745012 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b5601436-3e80-4b54-90a4-23a3a5dca554 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:37.752299 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b5601436-3e80-4b54-90a4-23a3a5dca554 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.320920 Feb 08 16:42:37.752869 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 107/209] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:37 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:37.992117 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-aaa4bcf0-3f46-4218-a8b8-b2d276f8da53 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:37.992637 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-aaa4bcf0-3f46-4218-a8b8-b2d276f8da53 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:37.998466 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-aaa4bcf0-3f46-4218-a8b8-b2d276f8da53 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:37.998915 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-aaa4bcf0-3f46-4218-a8b8-b2d276f8da53 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:37.999687 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-aaa4bcf0-3f46-4218-a8b8-b2d276f8da53 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:38.000164 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-aaa4bcf0-3f46-4218-a8b8-b2d276f8da53 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:38.130319 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-aaa4bcf0-3f46-4218-a8b8-b2d276f8da53 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:38.138397 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-aaa4bcf0-3f46-4218-a8b8-b2d276f8da53 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:38.139948 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-aaa4bcf0-3f46-4218-a8b8-b2d276f8da53 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:38.141039 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-aaa4bcf0-3f46-4218-a8b8-b2d276f8da53 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.152733 Feb 08 16:42:38.141595 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 103/210] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:37 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:38.277142 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-fa2e54a7-1abe-4ad8-98b8-c8c4d707ceda tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:38.277941 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-fa2e54a7-1abe-4ad8-98b8-c8c4d707ceda tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:38.283883 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fa2e54a7-1abe-4ad8-98b8-c8c4d707ceda tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:38.284345 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fa2e54a7-1abe-4ad8-98b8-c8c4d707ceda tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:38.285156 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fa2e54a7-1abe-4ad8-98b8-c8c4d707ceda tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:38.286459 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fa2e54a7-1abe-4ad8-98b8-c8c4d707ceda tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:38.422354 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-fa2e54a7-1abe-4ad8-98b8-c8c4d707ceda tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:38.429618 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-fa2e54a7-1abe-4ad8-98b8-c8c4d707ceda tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.156628 Feb 08 16:42:38.430186 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 108/211] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:38 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:38.770852 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-823acd12-a25d-4421-b4a8-2cee8b9ebef7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:38.771376 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-823acd12-a25d-4421-b4a8-2cee8b9ebef7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:38.779227 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-823acd12-a25d-4421-b4a8-2cee8b9ebef7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:38.779675 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-823acd12-a25d-4421-b4a8-2cee8b9ebef7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:38.780840 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-823acd12-a25d-4421-b4a8-2cee8b9ebef7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:38.781044 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-823acd12-a25d-4421-b4a8-2cee8b9ebef7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:38.925132 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-823acd12-a25d-4421-b4a8-2cee8b9ebef7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:38.932694 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-823acd12-a25d-4421-b4a8-2cee8b9ebef7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.166744 Feb 08 16:42:38.933266 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 104/212] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:38 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:39.159439 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-22a00303-83ba-4795-98c2-444f822c9b51 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:39.160056 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-22a00303-83ba-4795-98c2-444f822c9b51 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:39.166194 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-22a00303-83ba-4795-98c2-444f822c9b51 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:39.166647 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-22a00303-83ba-4795-98c2-444f822c9b51 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:39.167414 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-22a00303-83ba-4795-98c2-444f822c9b51 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:39.167876 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-22a00303-83ba-4795-98c2-444f822c9b51 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:39.299186 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-22a00303-83ba-4795-98c2-444f822c9b51 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:39.306988 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-22a00303-83ba-4795-98c2-444f822c9b51 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:39.308509 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-22a00303-83ba-4795-98c2-444f822c9b51 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:39.309686 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-22a00303-83ba-4795-98c2-444f822c9b51 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.153861 Feb 08 16:42:39.310159 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 109/213] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:39 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:39.446863 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-267a2738-ab65-47bd-ac54-e010847da4c9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:39.447455 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-267a2738-ab65-47bd-ac54-e010847da4c9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:39.453272 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-267a2738-ab65-47bd-ac54-e010847da4c9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:39.453723 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-267a2738-ab65-47bd-ac54-e010847da4c9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:39.454495 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-267a2738-ab65-47bd-ac54-e010847da4c9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:39.454929 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-267a2738-ab65-47bd-ac54-e010847da4c9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:39.588636 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-267a2738-ab65-47bd-ac54-e010847da4c9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:39.595800 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-267a2738-ab65-47bd-ac54-e010847da4c9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.153546 Feb 08 16:42:39.596360 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 105/214] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:39 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:39.949109 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-90c5186b-d9ea-4fd2-825d-476483263bf8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:39.949718 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-90c5186b-d9ea-4fd2-825d-476483263bf8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:39.955615 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-90c5186b-d9ea-4fd2-825d-476483263bf8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:39.956111 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-90c5186b-d9ea-4fd2-825d-476483263bf8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:39.956884 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-90c5186b-d9ea-4fd2-825d-476483263bf8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:39.957331 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-90c5186b-d9ea-4fd2-825d-476483263bf8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:40.087282 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-90c5186b-d9ea-4fd2-825d-476483263bf8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:40.094753 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-90c5186b-d9ea-4fd2-825d-476483263bf8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.149475 Feb 08 16:42:40.095358 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 110/215] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:39 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:40.326398 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-08b623be-9ec9-497f-a360-6b78709f8346 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:40.327005 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-08b623be-9ec9-497f-a360-6b78709f8346 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:40.332970 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-08b623be-9ec9-497f-a360-6b78709f8346 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:40.333418 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-08b623be-9ec9-497f-a360-6b78709f8346 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:40.334234 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-08b623be-9ec9-497f-a360-6b78709f8346 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:40.336289 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-08b623be-9ec9-497f-a360-6b78709f8346 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:40.482796 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-08b623be-9ec9-497f-a360-6b78709f8346 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:40.490553 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-08b623be-9ec9-497f-a360-6b78709f8346 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:40.492122 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-08b623be-9ec9-497f-a360-6b78709f8346 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:40.493214 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-08b623be-9ec9-497f-a360-6b78709f8346 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.170533 Feb 08 16:42:40.493780 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 106/216] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:40 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:40.611974 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b755f9b5-9011-4666-9677-7fae6f68b6a2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:40.612605 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b755f9b5-9011-4666-9677-7fae6f68b6a2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:40.618652 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b755f9b5-9011-4666-9677-7fae6f68b6a2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:40.619094 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b755f9b5-9011-4666-9677-7fae6f68b6a2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:40.619889 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b755f9b5-9011-4666-9677-7fae6f68b6a2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:40.620320 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b755f9b5-9011-4666-9677-7fae6f68b6a2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:40.753994 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b755f9b5-9011-4666-9677-7fae6f68b6a2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:40.761601 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b755f9b5-9011-4666-9677-7fae6f68b6a2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.153169 Feb 08 16:42:40.762159 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 111/217] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:40 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:41.111567 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-4c060a5f-0b15-4220-b03b-ab3054df9880 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:41.112188 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4c060a5f-0b15-4220-b03b-ab3054df9880 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:41.118160 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4c060a5f-0b15-4220-b03b-ab3054df9880 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:41.118605 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4c060a5f-0b15-4220-b03b-ab3054df9880 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:41.119370 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4c060a5f-0b15-4220-b03b-ab3054df9880 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:41.119826 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4c060a5f-0b15-4220-b03b-ab3054df9880 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:41.248069 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4c060a5f-0b15-4220-b03b-ab3054df9880 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:41.255148 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-4c060a5f-0b15-4220-b03b-ab3054df9880 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.147206 Feb 08 16:42:41.255975 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 107/218] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:41 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:41.510909 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-fe836601-a562-4243-86b6-18299a3b869d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:41.511518 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-fe836601-a562-4243-86b6-18299a3b869d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:41.517325 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fe836601-a562-4243-86b6-18299a3b869d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:41.517779 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fe836601-a562-4243-86b6-18299a3b869d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:41.518551 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fe836601-a562-4243-86b6-18299a3b869d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:41.518983 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fe836601-a562-4243-86b6-18299a3b869d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:41.651379 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-fe836601-a562-4243-86b6-18299a3b869d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:41.659143 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-fe836601-a562-4243-86b6-18299a3b869d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:41.660705 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-fe836601-a562-4243-86b6-18299a3b869d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:41.661820 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-fe836601-a562-4243-86b6-18299a3b869d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.155034 Feb 08 16:42:41.662374 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 112/219] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:41 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:41.777723 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-1bfbf464-1a31-424b-8ad0-3b751659d243 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:41.778384 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-1bfbf464-1a31-424b-8ad0-3b751659d243 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:41.784119 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1bfbf464-1a31-424b-8ad0-3b751659d243 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:41.784563 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1bfbf464-1a31-424b-8ad0-3b751659d243 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:41.785325 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1bfbf464-1a31-424b-8ad0-3b751659d243 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:41.785753 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1bfbf464-1a31-424b-8ad0-3b751659d243 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:41.914038 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-1bfbf464-1a31-424b-8ad0-3b751659d243 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:41.921217 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-1bfbf464-1a31-424b-8ad0-3b751659d243 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.147059 Feb 08 16:42:41.921781 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 108/220] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:41 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:42.271364 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-39b80de0-4b55-481b-ab75-0e5f08631653 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:42.271932 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-39b80de0-4b55-481b-ab75-0e5f08631653 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:42.279253 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-39b80de0-4b55-481b-ab75-0e5f08631653 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:42.279705 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-39b80de0-4b55-481b-ab75-0e5f08631653 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:42.280506 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-39b80de0-4b55-481b-ab75-0e5f08631653 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:42.280934 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-39b80de0-4b55-481b-ab75-0e5f08631653 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:42.423116 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-39b80de0-4b55-481b-ab75-0e5f08631653 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:42.431053 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-39b80de0-4b55-481b-ab75-0e5f08631653 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.163771 Feb 08 16:42:42.432021 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 113/221] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:42 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:42.678967 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ba8133dc-9c3f-46a1-8652-24d9179371b3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:42.679964 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-ba8133dc-9c3f-46a1-8652-24d9179371b3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:42.685908 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ba8133dc-9c3f-46a1-8652-24d9179371b3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:42.686473 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ba8133dc-9c3f-46a1-8652-24d9179371b3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:42.687308 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ba8133dc-9c3f-46a1-8652-24d9179371b3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:42.687835 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ba8133dc-9c3f-46a1-8652-24d9179371b3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:42.824900 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ba8133dc-9c3f-46a1-8652-24d9179371b3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:42.832762 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ba8133dc-9c3f-46a1-8652-24d9179371b3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:42.834325 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ba8133dc-9c3f-46a1-8652-24d9179371b3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:42.835492 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-ba8133dc-9c3f-46a1-8652-24d9179371b3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.160279 Feb 08 16:42:42.836721 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 109/222] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:42 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:42.938114 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-fbdb2749-f046-40f7-a6ea-424b3a8ce0d9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:42.938718 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-fbdb2749-f046-40f7-a6ea-424b3a8ce0d9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:42.945175 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fbdb2749-f046-40f7-a6ea-424b3a8ce0d9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:42.945628 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fbdb2749-f046-40f7-a6ea-424b3a8ce0d9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:42.946479 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fbdb2749-f046-40f7-a6ea-424b3a8ce0d9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:42.946937 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fbdb2749-f046-40f7-a6ea-424b3a8ce0d9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:43.075725 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-fbdb2749-f046-40f7-a6ea-424b3a8ce0d9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:43.083190 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-fbdb2749-f046-40f7-a6ea-424b3a8ce0d9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.148672 Feb 08 16:42:43.083777 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 114/223] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:42 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:43.446853 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-2d9897f2-36bf-4e78-bea3-0e61764fd961 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:43.447454 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-2d9897f2-36bf-4e78-bea3-0e61764fd961 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:43.453779 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2d9897f2-36bf-4e78-bea3-0e61764fd961 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:43.454222 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2d9897f2-36bf-4e78-bea3-0e61764fd961 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:43.454985 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2d9897f2-36bf-4e78-bea3-0e61764fd961 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:43.455413 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2d9897f2-36bf-4e78-bea3-0e61764fd961 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:43.590846 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-2d9897f2-36bf-4e78-bea3-0e61764fd961 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:43.597986 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-2d9897f2-36bf-4e78-bea3-0e61764fd961 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.154919 Feb 08 16:42:43.598858 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 110/224] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:43 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:43.853884 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-2e4c28fa-c514-4883-bcc0-b033a1e66b72 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:43.854430 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-2e4c28fa-c514-4883-bcc0-b033a1e66b72 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:43.860292 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2e4c28fa-c514-4883-bcc0-b033a1e66b72 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:43.860733 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2e4c28fa-c514-4883-bcc0-b033a1e66b72 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:43.861524 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2e4c28fa-c514-4883-bcc0-b033a1e66b72 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:43.861955 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2e4c28fa-c514-4883-bcc0-b033a1e66b72 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:43.996256 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-2e4c28fa-c514-4883-bcc0-b033a1e66b72 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:44.004218 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-2e4c28fa-c514-4883-bcc0-b033a1e66b72 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:44.005989 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-2e4c28fa-c514-4883-bcc0-b033a1e66b72 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:44.007099 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-2e4c28fa-c514-4883-bcc0-b033a1e66b72 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.157120 Feb 08 16:42:44.008303 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 115/225] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:43 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:44.100115 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-491b2efa-1b57-4c6e-91da-41de3b5a7aa9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:44.100729 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-491b2efa-1b57-4c6e-91da-41de3b5a7aa9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:44.106999 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-491b2efa-1b57-4c6e-91da-41de3b5a7aa9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:44.107390 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-491b2efa-1b57-4c6e-91da-41de3b5a7aa9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:44.108205 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-491b2efa-1b57-4c6e-91da-41de3b5a7aa9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:44.108648 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-491b2efa-1b57-4c6e-91da-41de3b5a7aa9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:44.245017 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-491b2efa-1b57-4c6e-91da-41de3b5a7aa9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:44.252200 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-491b2efa-1b57-4c6e-91da-41de3b5a7aa9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.155669 Feb 08 16:42:44.252767 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 111/226] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:44 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:44.614610 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e521205b-3ad0-4d6f-a9ab-8d592f5fc636 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:44.615141 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e521205b-3ad0-4d6f-a9ab-8d592f5fc636 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:44.621633 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e521205b-3ad0-4d6f-a9ab-8d592f5fc636 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:44.622088 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e521205b-3ad0-4d6f-a9ab-8d592f5fc636 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:44.622872 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e521205b-3ad0-4d6f-a9ab-8d592f5fc636 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:44.623334 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e521205b-3ad0-4d6f-a9ab-8d592f5fc636 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:44.765503 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e521205b-3ad0-4d6f-a9ab-8d592f5fc636 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:44.772622 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e521205b-3ad0-4d6f-a9ab-8d592f5fc636 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.161777 Feb 08 16:42:44.773191 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 116/227] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:44 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:45.025393 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d4b09f4d-e91d-46cb-9cd8-048e64a8a8a2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:45.025913 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-d4b09f4d-e91d-46cb-9cd8-048e64a8a8a2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:45.031776 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d4b09f4d-e91d-46cb-9cd8-048e64a8a8a2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:45.032267 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d4b09f4d-e91d-46cb-9cd8-048e64a8a8a2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:45.033040 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d4b09f4d-e91d-46cb-9cd8-048e64a8a8a2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:45.033472 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d4b09f4d-e91d-46cb-9cd8-048e64a8a8a2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:45.162468 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d4b09f4d-e91d-46cb-9cd8-048e64a8a8a2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:45.170669 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d4b09f4d-e91d-46cb-9cd8-048e64a8a8a2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:45.172178 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d4b09f4d-e91d-46cb-9cd8-048e64a8a8a2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:45.173289 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d4b09f4d-e91d-46cb-9cd8-048e64a8a8a2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.151989 Feb 08 16:42:45.173846 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 112/228] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:45 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:45.269580 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-8ac2108d-99e2-4428-abdd-6844011012fe tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:45.270184 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-8ac2108d-99e2-4428-abdd-6844011012fe tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:45.276754 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8ac2108d-99e2-4428-abdd-6844011012fe tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:45.277144 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8ac2108d-99e2-4428-abdd-6844011012fe tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:45.277912 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8ac2108d-99e2-4428-abdd-6844011012fe tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:45.278345 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8ac2108d-99e2-4428-abdd-6844011012fe tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:45.412447 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-8ac2108d-99e2-4428-abdd-6844011012fe tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:45.420365 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-8ac2108d-99e2-4428-abdd-6844011012fe tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.154410 Feb 08 16:42:45.420929 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 117/229] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:45 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:45.789012 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-1eceecca-ce1e-4fa2-901d-adbd698b698d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:45.789927 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-1eceecca-ce1e-4fa2-901d-adbd698b698d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:45.796559 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1eceecca-ce1e-4fa2-901d-adbd698b698d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:45.797011 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1eceecca-ce1e-4fa2-901d-adbd698b698d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:45.797805 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1eceecca-ce1e-4fa2-901d-adbd698b698d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:45.798242 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1eceecca-ce1e-4fa2-901d-adbd698b698d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:45.935358 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-1eceecca-ce1e-4fa2-901d-adbd698b698d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:45.942552 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-1eceecca-ce1e-4fa2-901d-adbd698b698d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.157877 Feb 08 16:42:45.943116 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 113/230] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:45 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:46.191693 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-f04e0be9-37cc-41ab-a0b2-e1c00bc4aeed tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:46.192266 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-f04e0be9-37cc-41ab-a0b2-e1c00bc4aeed tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:46.198959 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f04e0be9-37cc-41ab-a0b2-e1c00bc4aeed tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:46.199411 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f04e0be9-37cc-41ab-a0b2-e1c00bc4aeed tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:46.200236 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f04e0be9-37cc-41ab-a0b2-e1c00bc4aeed tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:46.200674 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f04e0be9-37cc-41ab-a0b2-e1c00bc4aeed tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:46.335689 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-f04e0be9-37cc-41ab-a0b2-e1c00bc4aeed tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:46.343461 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-f04e0be9-37cc-41ab-a0b2-e1c00bc4aeed tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:46.344987 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-f04e0be9-37cc-41ab-a0b2-e1c00bc4aeed tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:46.346086 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-f04e0be9-37cc-41ab-a0b2-e1c00bc4aeed tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.158229 Feb 08 16:42:46.346650 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 118/231] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:46 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:46.437756 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-3ac49869-28e8-471f-90cc-ef4c3e5a5819 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:46.438384 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-3ac49869-28e8-471f-90cc-ef4c3e5a5819 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:46.444204 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3ac49869-28e8-471f-90cc-ef4c3e5a5819 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:46.445200 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3ac49869-28e8-471f-90cc-ef4c3e5a5819 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:46.445968 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3ac49869-28e8-471f-90cc-ef4c3e5a5819 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:46.446394 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3ac49869-28e8-471f-90cc-ef4c3e5a5819 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:46.603695 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-3ac49869-28e8-471f-90cc-ef4c3e5a5819 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:46.611443 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-3ac49869-28e8-471f-90cc-ef4c3e5a5819 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1362 microversion: 2.1 time: 0.177261 Feb 08 16:42:46.612076 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 114/232] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:46 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:46.959339 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-fb098be0-f0c8-440e-b567-846b1ebfa27f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:46.959980 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-fb098be0-f0c8-440e-b567-846b1ebfa27f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:46.966606 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb098be0-f0c8-440e-b567-846b1ebfa27f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:46.966980 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb098be0-f0c8-440e-b567-846b1ebfa27f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:46.967791 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb098be0-f0c8-440e-b567-846b1ebfa27f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:46.968217 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb098be0-f0c8-440e-b567-846b1ebfa27f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:47.107939 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-fb098be0-f0c8-440e-b567-846b1ebfa27f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:47.115199 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-fb098be0-f0c8-440e-b567-846b1ebfa27f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1322 microversion: 2.1 time: 0.159525 Feb 08 16:42:47.115777 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 119/233] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:46 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:47.363366 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-407a81b0-257f-425f-ba45-3fc817df7927 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:47.363993 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-407a81b0-257f-425f-ba45-3fc817df7927 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:47.369620 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-407a81b0-257f-425f-ba45-3fc817df7927 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:47.370064 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-407a81b0-257f-425f-ba45-3fc817df7927 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:47.370852 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-407a81b0-257f-425f-ba45-3fc817df7927 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:47.371260 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-407a81b0-257f-425f-ba45-3fc817df7927 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:47.518754 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-407a81b0-257f-425f-ba45-3fc817df7927 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:47.528506 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-407a81b0-257f-425f-ba45-3fc817df7927 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:47.530139 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-407a81b0-257f-425f-ba45-3fc817df7927 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:47.531688 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-407a81b0-257f-425f-ba45-3fc817df7927 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1406 microversion: 2.20 time: 0.171957 Feb 08 16:42:47.542729 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 115/234] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:47 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:47.634242 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-77f1556a-9467-476a-a930-69a42319ac85 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:47.635434 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-77f1556a-9467-476a-a930-69a42319ac85 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:47.653839 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-77f1556a-9467-476a-a930-69a42319ac85 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:47.654509 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-77f1556a-9467-476a-a930-69a42319ac85 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:47.655696 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-77f1556a-9467-476a-a930-69a42319ac85 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:47.656356 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-77f1556a-9467-476a-a930-69a42319ac85 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:47.963728 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-77f1556a-9467-476a-a930-69a42319ac85 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:47.972400 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-77f1556a-9467-476a-a930-69a42319ac85 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1549 microversion: 2.1 time: 0.347958 Feb 08 16:42:47.984474 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 120/235] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:47 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1549 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:47.991570 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-8778530c-a2b7-4f66-b6d2-0636d55eba19 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:47.997800 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-8778530c-a2b7-4f66-b6d2-0636d55eba19 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:48.006560 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8778530c-a2b7-4f66-b6d2-0636d55eba19 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:48.008197 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8778530c-a2b7-4f66-b6d2-0636d55eba19 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:48.009097 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8778530c-a2b7-4f66-b6d2-0636d55eba19 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:48.009629 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8778530c-a2b7-4f66-b6d2-0636d55eba19 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:48.137218 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-32751196-1143-4f1b-b815-c5a99a3c43cc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:48.138420 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-32751196-1143-4f1b-b815-c5a99a3c43cc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:48.146468 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-32751196-1143-4f1b-b815-c5a99a3c43cc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:48.147296 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-32751196-1143-4f1b-b815-c5a99a3c43cc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:48.148486 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-32751196-1143-4f1b-b815-c5a99a3c43cc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:48.149132 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-32751196-1143-4f1b-b815-c5a99a3c43cc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:48.172114 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-8778530c-a2b7-4f66-b6d2-0636d55eba19 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.184114 Feb 08 16:42:48.173411 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 116/236] 10.222.0.35 () {58 vars in 1274 bytes} [Tue Feb 8 16:42:47 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764/os-interface => generated 285 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:42:48.549894 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-31947a77-89c8-494a-bc6f-b82cebf9dddd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:48.550532 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-31947a77-89c8-494a-bc6f-b82cebf9dddd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:48.557263 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-31947a77-89c8-494a-bc6f-b82cebf9dddd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:48.557714 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-31947a77-89c8-494a-bc6f-b82cebf9dddd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:48.558498 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-31947a77-89c8-494a-bc6f-b82cebf9dddd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:48.558945 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-31947a77-89c8-494a-bc6f-b82cebf9dddd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:48.560517 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-32751196-1143-4f1b-b815-c5a99a3c43cc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:48.568531 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-32751196-1143-4f1b-b815-c5a99a3c43cc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1515 microversion: 2.1 time: 0.440003 Feb 08 16:42:48.570546 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 121/237] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:48 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1515 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:42:48.586401 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-36d713d6-c8bc-483f-9238-52e2661535f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:42:48.587728 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-36d713d6-c8bc-483f-9238-52e2661535f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:48.593863 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-36d713d6-c8bc-483f-9238-52e2661535f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:48.594308 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-36d713d6-c8bc-483f-9238-52e2661535f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:48.595090 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-36d713d6-c8bc-483f-9238-52e2661535f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:48.595690 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-36d713d6-c8bc-483f-9238-52e2661535f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:48.671510 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.objects.instance [None req-36d713d6-c8bc-483f-9238-52e2661535f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lazy-loading 'flavor' on Instance uuid 3491de9b-89ec-4861-b97f-f32158e658cc {{(pid=122902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:42:48.702195 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-31947a77-89c8-494a-bc6f-b82cebf9dddd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:48.712536 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-31947a77-89c8-494a-bc6f-b82cebf9dddd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:48.714585 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-31947a77-89c8-494a-bc6f-b82cebf9dddd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:48.716190 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-31947a77-89c8-494a-bc6f-b82cebf9dddd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1598 microversion: 2.20 time: 0.169985 Feb 08 16:42:48.716976 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 117/238] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:48 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:42:48.734108 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d5a98274-83db-47d7-8117-6e22ffd0c89b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:48.734602 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-d5a98274-83db-47d7-8117-6e22ffd0c89b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:48.740579 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d5a98274-83db-47d7-8117-6e22ffd0c89b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:48.741140 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d5a98274-83db-47d7-8117-6e22ffd0c89b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:48.743048 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d5a98274-83db-47d7-8117-6e22ffd0c89b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:48.743871 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d5a98274-83db-47d7-8117-6e22ffd0c89b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:48.812215 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-36d713d6-c8bc-483f-9238-52e2661535f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "POST /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc/action" status: 200 len: 32 microversion: 2.1 time: 0.229517 Feb 08 16:42:48.818802 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 122/239] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Feb 8 16:42:48 2022] POST /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc/action => generated 32 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 08 16:42:48.825457 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-1fb2ba00-ea0c-4836-b53e-9c339da681d4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:48.827160 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-1fb2ba00-ea0c-4836-b53e-9c339da681d4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:48.834666 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1fb2ba00-ea0c-4836-b53e-9c339da681d4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:48.835827 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1fb2ba00-ea0c-4836-b53e-9c339da681d4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:48.837141 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1fb2ba00-ea0c-4836-b53e-9c339da681d4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:48.845395 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d5a98274-83db-47d7-8117-6e22ffd0c89b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.114847 Feb 08 16:42:48.846811 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 118/240] 10.222.0.35 () {60 vars in 1315 bytes} [Tue Feb 8 16:42:48 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 08 16:42:48.848258 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1fb2ba00-ea0c-4836-b53e-9c339da681d4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:48.898131 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-2485d4bf-b675-45af-8b64-c718541632aa tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a2b09e2-7220-48a9-95ba-17acafc299e5"}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:42:48.900465 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-2485d4bf-b675-45af-8b64-c718541632aa tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:48.907062 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2485d4bf-b675-45af-8b64-c718541632aa tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:48.907831 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2485d4bf-b675-45af-8b64-c718541632aa tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:48.908853 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2485d4bf-b675-45af-8b64-c718541632aa tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:48.909714 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2485d4bf-b675-45af-8b64-c718541632aa tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:49.248086 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-2485d4bf-b675-45af-8b64-c718541632aa tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "POST /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.353447 Feb 08 16:42:49.249500 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 119/241] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Feb 8 16:42:48 2022] POST /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304/os-volume_attachments => generated 194 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:42:49.588864 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-1fb2ba00-ea0c-4836-b53e-9c339da681d4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:49.599443 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-1fb2ba00-ea0c-4836-b53e-9c339da681d4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.779158 Feb 08 16:42:49.600130 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 123/242] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:48 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:50.363152 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-c1778431-eba7-4675-a8fe-d17bab34e9ae tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:50.364912 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-c1778431-eba7-4675-a8fe-d17bab34e9ae tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:50.372472 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-8d861d65-620c-4ef1-82ce-8ab6ec969fbc req-eb0e6b03-e5ea-4ee2-8def-4143716103e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "136b1df1-a111-4a7b-8a8d-5e095dadc764", "tag": "f72c3bbd-5f67-4f43-a4c1-f7f6cc240f10"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:42:50.374765 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:42:50.374765 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:42:50.392343 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c1778431-eba7-4675-a8fe-d17bab34e9ae tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:50.404131 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c1778431-eba7-4675-a8fe-d17bab34e9ae tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:50.408834 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-8d861d65-620c-4ef1-82ce-8ab6ec969fbc req-eb0e6b03-e5ea-4ee2-8def-4143716103e0 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:50.411780 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-8d861d65-620c-4ef1-82ce-8ab6ec969fbc req-eb0e6b03-e5ea-4ee2-8def-4143716103e0 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:50.413606 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c1778431-eba7-4675-a8fe-d17bab34e9ae tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:50.414073 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c1778431-eba7-4675-a8fe-d17bab34e9ae tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:50.452471 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-8d861d65-620c-4ef1-82ce-8ab6ec969fbc req-eb0e6b03-e5ea-4ee2-8def-4143716103e0 service nova] Creating event network-changed:f72c3bbd-5f67-4f43-a4c1-f7f6cc240f10 for instance 136b1df1-a111-4a7b-8a8d-5e095dadc764 on hv-cinder-82786 Feb 08 16:42:50.462716 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-8d861d65-620c-4ef1-82ce-8ab6ec969fbc req-eb0e6b03-e5ea-4ee2-8def-4143716103e0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094532 Feb 08 16:42:50.463586 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 124/243] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:42:50.619005 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-44c4238f-07fb-4585-8b3a-92057d681608 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:50.619961 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-44c4238f-07fb-4585-8b3a-92057d681608 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:50.638579 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-44c4238f-07fb-4585-8b3a-92057d681608 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:50.639038 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-44c4238f-07fb-4585-8b3a-92057d681608 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:50.641252 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-44c4238f-07fb-4585-8b3a-92057d681608 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:50.641699 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-44c4238f-07fb-4585-8b3a-92057d681608 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:50.731577 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c1778431-eba7-4675-a8fe-d17bab34e9ae tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:50.745842 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-c1778431-eba7-4675-a8fe-d17bab34e9ae tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1549 microversion: 2.1 time: 0.386532 Feb 08 16:42:50.749730 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 120/244] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:50 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1549 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:50.760295 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-5696d99d-461c-448a-9594-2ab5b2726018 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:50.761929 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-5696d99d-461c-448a-9594-2ab5b2726018 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:50.776532 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5696d99d-461c-448a-9594-2ab5b2726018 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:50.776990 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5696d99d-461c-448a-9594-2ab5b2726018 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:50.778853 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5696d99d-461c-448a-9594-2ab5b2726018 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:50.779908 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5696d99d-461c-448a-9594-2ab5b2726018 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:51.023567 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-5696d99d-461c-448a-9594-2ab5b2726018 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:51.034407 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-5696d99d-461c-448a-9594-2ab5b2726018 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:51.042504 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-5696d99d-461c-448a-9594-2ab5b2726018 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:51.043011 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-5696d99d-461c-448a-9594-2ab5b2726018 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1598 microversion: 2.20 time: 0.290933 Feb 08 16:42:51.054175 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 121/245] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:50 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1598 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:51.054175 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-949243d2-2034-4d1c-b863-bc8821d4dc84 req-4cafc1bd-723f-454d-ad2f-38a551c88a37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da00c476-8246-413e-889c-d22fe63e2ef8", "tag": "dc601835-5363-4bdf-9b05-9e711057cbd2"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:42:51.054175 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:42:51.054175 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:42:51.063073 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-949243d2-2034-4d1c-b863-bc8821d4dc84 req-4cafc1bd-723f-454d-ad2f-38a551c88a37 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:51.064395 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-949243d2-2034-4d1c-b863-bc8821d4dc84 req-4cafc1bd-723f-454d-ad2f-38a551c88a37 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:51.078466 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-949243d2-2034-4d1c-b863-bc8821d4dc84 req-4cafc1bd-723f-454d-ad2f-38a551c88a37 service nova] Creating event network-changed:dc601835-5363-4bdf-9b05-9e711057cbd2 for instance da00c476-8246-413e-889c-d22fe63e2ef8 on hv-cinder-82786 Feb 08 16:42:51.084070 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-949243d2-2034-4d1c-b863-bc8821d4dc84 req-4cafc1bd-723f-454d-ad2f-38a551c88a37 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037686 Feb 08 16:42:51.086533 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 122/246] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:42:51.132949 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-44c4238f-07fb-4585-8b3a-92057d681608 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:51.145124 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-44c4238f-07fb-4585-8b3a-92057d681608 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.531361 Feb 08 16:42:51.145717 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 125/247] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:50 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:42:51.771417 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-3556c362-85a4-4564-a4b6-6a326f3b6ea5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:51.773412 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-3556c362-85a4-4564-a4b6-6a326f3b6ea5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:51.790498 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3556c362-85a4-4564-a4b6-6a326f3b6ea5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:51.791549 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3556c362-85a4-4564-a4b6-6a326f3b6ea5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:51.794712 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3556c362-85a4-4564-a4b6-6a326f3b6ea5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:51.806948 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3556c362-85a4-4564-a4b6-6a326f3b6ea5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:52.068184 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b4d0488a-6826-43d5-b79c-e0a2dc099bb0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:52.069657 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b4d0488a-6826-43d5-b79c-e0a2dc099bb0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:52.079704 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b4d0488a-6826-43d5-b79c-e0a2dc099bb0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:52.081466 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b4d0488a-6826-43d5-b79c-e0a2dc099bb0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:52.084236 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b4d0488a-6826-43d5-b79c-e0a2dc099bb0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:52.086137 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b4d0488a-6826-43d5-b79c-e0a2dc099bb0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:52.415589 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-3556c362-85a4-4564-a4b6-6a326f3b6ea5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:52.428553 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-3556c362-85a4-4564-a4b6-6a326f3b6ea5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1549 microversion: 2.1 time: 0.664001 Feb 08 16:42:52.431475 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 123/248] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:51 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1549 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:52.437595 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b4d0488a-6826-43d5-b79c-e0a2dc099bb0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:52.443409 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-4c4c1fd0-bfc9-4c42-97a3-27a78b3c92a0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:52.445237 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4c4c1fd0-bfc9-4c42-97a3-27a78b3c92a0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:52.458028 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b4d0488a-6826-43d5-b79c-e0a2dc099bb0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:52.460530 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4c4c1fd0-bfc9-4c42-97a3-27a78b3c92a0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:52.460796 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b4d0488a-6826-43d5-b79c-e0a2dc099bb0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:52.463793 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4c4c1fd0-bfc9-4c42-97a3-27a78b3c92a0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:52.464792 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4c4c1fd0-bfc9-4c42-97a3-27a78b3c92a0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:52.467469 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b4d0488a-6826-43d5-b79c-e0a2dc099bb0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1598 microversion: 2.20 time: 0.402617 Feb 08 16:42:52.468406 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4c4c1fd0-bfc9-4c42-97a3-27a78b3c92a0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:52.475558 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 126/249] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:52 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1598 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:42:52.838681 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4c4c1fd0-bfc9-4c42-97a3-27a78b3c92a0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:52.849052 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-4c4c1fd0-bfc9-4c42-97a3-27a78b3c92a0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.415931 Feb 08 16:42:52.850119 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 124/250] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:52 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:53.449635 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-a20f42b0-5e68-4a60-8eb9-7092a613a123 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:53.450346 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-a20f42b0-5e68-4a60-8eb9-7092a613a123 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:53.456616 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a20f42b0-5e68-4a60-8eb9-7092a613a123 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:53.457062 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a20f42b0-5e68-4a60-8eb9-7092a613a123 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:53.457833 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a20f42b0-5e68-4a60-8eb9-7092a613a123 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:53.458416 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a20f42b0-5e68-4a60-8eb9-7092a613a123 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:53.497797 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e8dc8cca-69cc-415b-8372-7fb750af1cb6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:53.498412 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e8dc8cca-69cc-415b-8372-7fb750af1cb6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:53.508036 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e8dc8cca-69cc-415b-8372-7fb750af1cb6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:53.508800 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e8dc8cca-69cc-415b-8372-7fb750af1cb6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:53.509955 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e8dc8cca-69cc-415b-8372-7fb750af1cb6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:53.510775 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e8dc8cca-69cc-415b-8372-7fb750af1cb6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:53.778866 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e8dc8cca-69cc-415b-8372-7fb750af1cb6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:53.789292 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-a20f42b0-5e68-4a60-8eb9-7092a613a123 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:53.792314 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e8dc8cca-69cc-415b-8372-7fb750af1cb6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:53.795524 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e8dc8cca-69cc-415b-8372-7fb750af1cb6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:53.797699 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e8dc8cca-69cc-415b-8372-7fb750af1cb6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1716 microversion: 2.20 time: 0.303659 Feb 08 16:42:53.799228 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 125/251] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:42:53 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1716 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:42:53.808359 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-a20f42b0-5e68-4a60-8eb9-7092a613a123 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1668 microversion: 2.1 time: 0.362225 Feb 08 16:42:53.815092 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 127/252] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:53 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1668 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:53.829074 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-68d878e3-cdf9-4fe5-a8a7-595581acfef5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:53.838561 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-68d878e3-cdf9-4fe5-a8a7-595581acfef5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:53.847066 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-f0e4579d-5145-4328-b90f-e73ee8f07327 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:53.848239 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-f0e4579d-5145-4328-b90f-e73ee8f07327 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:53.861318 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-68d878e3-cdf9-4fe5-a8a7-595581acfef5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:53.862689 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-68d878e3-cdf9-4fe5-a8a7-595581acfef5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:53.865578 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f0e4579d-5145-4328-b90f-e73ee8f07327 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:53.866504 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-68d878e3-cdf9-4fe5-a8a7-595581acfef5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:53.867019 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-68d878e3-cdf9-4fe5-a8a7-595581acfef5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:53.868416 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f0e4579d-5145-4328-b90f-e73ee8f07327 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:53.870244 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f0e4579d-5145-4328-b90f-e73ee8f07327 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:53.871566 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f0e4579d-5145-4328-b90f-e73ee8f07327 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:53.913697 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-68d878e3-cdf9-4fe5-a8a7-595581acfef5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/ips" status: 200 len: 151 microversion: 2.20 time: 0.089797 Feb 08 16:42:53.927439 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 126/253] 10.222.0.35 () {60 vars in 1288 bytes} [Tue Feb 8 16:42:53 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/ips => generated 151 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:42:53.927629 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-f0e4579d-5145-4328-b90f-e73ee8f07327 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764/ips" status: 200 len: 147 microversion: 2.1 time: 0.088676 Feb 08 16:42:53.927629 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 128/254] 10.222.0.35 () {58 vars in 1247 bytes} [Tue Feb 8 16:42:53 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764/ips => generated 147 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:42:53.932941 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-aaa64d91-7a0a-4bd7-b3ab-9410175af787 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:53.933887 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-aaa64d91-7a0a-4bd7-b3ab-9410175af787 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:53.941288 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-aaa64d91-7a0a-4bd7-b3ab-9410175af787 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:53.941763 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-aaa64d91-7a0a-4bd7-b3ab-9410175af787 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:53.943441 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-aaa64d91-7a0a-4bd7-b3ab-9410175af787 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:53.943989 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-aaa64d91-7a0a-4bd7-b3ab-9410175af787 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:54.129484 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-aaa64d91-7a0a-4bd7-b3ab-9410175af787 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:54.140468 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-aaa64d91-7a0a-4bd7-b3ab-9410175af787 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.216765 Feb 08 16:42:54.141934 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 127/255] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:53 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:55.162116 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-93c0ff19-e9e5-49d4-8443-dce51ebf85e0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:55.163538 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-93c0ff19-e9e5-49d4-8443-dce51ebf85e0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:55.170068 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-93c0ff19-e9e5-49d4-8443-dce51ebf85e0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:55.170677 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-93c0ff19-e9e5-49d4-8443-dce51ebf85e0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:55.171369 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-93c0ff19-e9e5-49d4-8443-dce51ebf85e0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:55.172092 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-93c0ff19-e9e5-49d4-8443-dce51ebf85e0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:55.353837 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-93c0ff19-e9e5-49d4-8443-dce51ebf85e0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:55.363337 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-93c0ff19-e9e5-49d4-8443-dce51ebf85e0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.204736 Feb 08 16:42:55.364761 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 129/256] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:55 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:56.384948 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e36c4050-d1bf-4b0b-ab4c-37411895258a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:56.386263 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e36c4050-d1bf-4b0b-ab4c-37411895258a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:56.393392 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e36c4050-d1bf-4b0b-ab4c-37411895258a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:56.394207 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e36c4050-d1bf-4b0b-ab4c-37411895258a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:56.396181 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e36c4050-d1bf-4b0b-ab4c-37411895258a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:56.396836 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e36c4050-d1bf-4b0b-ab4c-37411895258a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:56.604909 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e36c4050-d1bf-4b0b-ab4c-37411895258a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:56.612783 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e36c4050-d1bf-4b0b-ab4c-37411895258a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.234483 Feb 08 16:42:56.613593 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 128/257] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:56 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:57.631434 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-cda76833-4bc5-43eb-bedf-43a8c1277e53 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:57.633197 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-cda76833-4bc5-43eb-bedf-43a8c1277e53 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:57.641969 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cda76833-4bc5-43eb-bedf-43a8c1277e53 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:57.642789 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cda76833-4bc5-43eb-bedf-43a8c1277e53 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:57.644028 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cda76833-4bc5-43eb-bedf-43a8c1277e53 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:57.644809 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cda76833-4bc5-43eb-bedf-43a8c1277e53 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:57.794839 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-cda76833-4bc5-43eb-bedf-43a8c1277e53 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:57.802336 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-cda76833-4bc5-43eb-bedf-43a8c1277e53 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.174856 Feb 08 16:42:57.807841 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 130/258] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:57 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:42:58.820580 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-a7866b08-5852-44f5-9e92-04d3992bd101 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:42:58.822110 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-a7866b08-5852-44f5-9e92-04d3992bd101 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:42:58.828576 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a7866b08-5852-44f5-9e92-04d3992bd101 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:58.829022 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a7866b08-5852-44f5-9e92-04d3992bd101 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:58.830012 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a7866b08-5852-44f5-9e92-04d3992bd101 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:42:58.830441 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a7866b08-5852-44f5-9e92-04d3992bd101 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:42:59.000719 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-a7866b08-5852-44f5-9e92-04d3992bd101 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:42:59.009172 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-a7866b08-5852-44f5-9e92-04d3992bd101 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.193415 Feb 08 16:42:59.009750 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 129/259] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:42:58 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:00.026622 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-1e4af207-a0d8-477d-bc48-b184413e1992 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:00.027352 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-1e4af207-a0d8-477d-bc48-b184413e1992 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:00.033886 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1e4af207-a0d8-477d-bc48-b184413e1992 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:00.034373 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1e4af207-a0d8-477d-bc48-b184413e1992 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:00.035159 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1e4af207-a0d8-477d-bc48-b184413e1992 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:00.035595 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1e4af207-a0d8-477d-bc48-b184413e1992 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:00.176861 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-1e4af207-a0d8-477d-bc48-b184413e1992 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:00.186970 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-1e4af207-a0d8-477d-bc48-b184413e1992 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.164686 Feb 08 16:43:00.187705 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 131/260] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:00 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:01.203454 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-9ca1293a-d29f-44ed-aa98-38066620f6ec tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:01.204081 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-9ca1293a-d29f-44ed-aa98-38066620f6ec tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:01.210273 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9ca1293a-d29f-44ed-aa98-38066620f6ec tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:01.210751 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9ca1293a-d29f-44ed-aa98-38066620f6ec tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:01.211737 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9ca1293a-d29f-44ed-aa98-38066620f6ec tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:01.212186 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9ca1293a-d29f-44ed-aa98-38066620f6ec tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:01.347009 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-9ca1293a-d29f-44ed-aa98-38066620f6ec tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:01.354228 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-9ca1293a-d29f-44ed-aa98-38066620f6ec tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.154313 Feb 08 16:43:01.354820 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 130/261] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:01 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:02.370832 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c0ae05c5-e332-4541-8542-e26ca5e65dca tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:02.371675 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c0ae05c5-e332-4541-8542-e26ca5e65dca tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:02.378159 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c0ae05c5-e332-4541-8542-e26ca5e65dca tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:02.378607 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c0ae05c5-e332-4541-8542-e26ca5e65dca tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:02.379446 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c0ae05c5-e332-4541-8542-e26ca5e65dca tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:02.380025 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c0ae05c5-e332-4541-8542-e26ca5e65dca tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:02.518206 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c0ae05c5-e332-4541-8542-e26ca5e65dca tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:02.526318 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c0ae05c5-e332-4541-8542-e26ca5e65dca tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.159766 Feb 08 16:43:02.526884 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 132/262] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:02 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:03.343811 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-bf053256-336a-4bfc-95e1-d4cee4af6229 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:03.344327 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-bf053256-336a-4bfc-95e1-d4cee4af6229 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:03.350539 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bf053256-336a-4bfc-95e1-d4cee4af6229 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:03.351108 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bf053256-336a-4bfc-95e1-d4cee4af6229 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:03.352142 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bf053256-336a-4bfc-95e1-d4cee4af6229 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:03.352629 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bf053256-336a-4bfc-95e1-d4cee4af6229 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:03.377900 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-bf053256-336a-4bfc-95e1-d4cee4af6229 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Going to try to terminate instance {{(pid=122901) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 16:43:03.469929 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-bf053256-336a-4bfc-95e1-d4cee4af6229 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "DELETE /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 204 len: 0 microversion: 2.1 time: 0.129517 Feb 08 16:43:03.470525 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 131/263] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Feb 8 16:43:03 2022] DELETE /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 16:43:03.478403 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-6a4d8585-6b7f-45ec-9cc2-c9eeef6f7c32 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:03.479081 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-6a4d8585-6b7f-45ec-9cc2-c9eeef6f7c32 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:03.485051 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6a4d8585-6b7f-45ec-9cc2-c9eeef6f7c32 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:03.485499 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6a4d8585-6b7f-45ec-9cc2-c9eeef6f7c32 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:03.486433 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6a4d8585-6b7f-45ec-9cc2-c9eeef6f7c32 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:03.486788 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6a4d8585-6b7f-45ec-9cc2-c9eeef6f7c32 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:03.545915 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-3ce5bfcd-dea8-4a29-86c3-e2ad2f756562 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:03.546606 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-3ce5bfcd-dea8-4a29-86c3-e2ad2f756562 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:03.553934 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3ce5bfcd-dea8-4a29-86c3-e2ad2f756562 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:03.555081 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3ce5bfcd-dea8-4a29-86c3-e2ad2f756562 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:03.556406 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3ce5bfcd-dea8-4a29-86c3-e2ad2f756562 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:03.556855 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3ce5bfcd-dea8-4a29-86c3-e2ad2f756562 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:03.634228 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-6a4d8585-6b7f-45ec-9cc2-c9eeef6f7c32 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:03.644024 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-6a4d8585-6b7f-45ec-9cc2-c9eeef6f7c32 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1554 microversion: 2.1 time: 0.169112 Feb 08 16:43:03.644605 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 133/264] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:03 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:03.706728 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-3ce5bfcd-dea8-4a29-86c3-e2ad2f756562 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:03.714013 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-3ce5bfcd-dea8-4a29-86c3-e2ad2f756562 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.172121 Feb 08 16:43:03.714578 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 132/265] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:03 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:04.661130 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c5a441f3-4375-4915-8b72-6858b46b10a6 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:04.661707 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c5a441f3-4375-4915-8b72-6858b46b10a6 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:04.668382 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c5a441f3-4375-4915-8b72-6858b46b10a6 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:04.669161 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c5a441f3-4375-4915-8b72-6858b46b10a6 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:04.670175 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c5a441f3-4375-4915-8b72-6858b46b10a6 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:04.670812 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c5a441f3-4375-4915-8b72-6858b46b10a6 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:04.730769 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-5035e891-ac95-4a2b-9f2c-f77e1cc7e4dc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:04.731378 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-5035e891-ac95-4a2b-9f2c-f77e1cc7e4dc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:04.737866 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5035e891-ac95-4a2b-9f2c-f77e1cc7e4dc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:04.738322 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5035e891-ac95-4a2b-9f2c-f77e1cc7e4dc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:04.739115 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5035e891-ac95-4a2b-9f2c-f77e1cc7e4dc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:04.739553 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5035e891-ac95-4a2b-9f2c-f77e1cc7e4dc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:04.846746 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c5a441f3-4375-4915-8b72-6858b46b10a6 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:04.855403 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c5a441f3-4375-4915-8b72-6858b46b10a6 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1554 microversion: 2.1 time: 0.197845 Feb 08 16:43:04.856015 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 134/266] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:04 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1554 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:05.010751 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-5035e891-ac95-4a2b-9f2c-f77e1cc7e4dc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:05.018308 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-5035e891-ac95-4a2b-9f2c-f77e1cc7e4dc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.291174 Feb 08 16:43:05.018891 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 133/267] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:04 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:05.870699 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-ad972ac0-dbed-41d3-be6e-c7012f3d679b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:05.872216 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-ad972ac0-dbed-41d3-be6e-c7012f3d679b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:05.879011 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ad972ac0-dbed-41d3-be6e-c7012f3d679b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:05.879712 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ad972ac0-dbed-41d3-be6e-c7012f3d679b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:05.881035 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ad972ac0-dbed-41d3-be6e-c7012f3d679b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:05.881589 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ad972ac0-dbed-41d3-be6e-c7012f3d679b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:06.034496 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-55ba9b45-b7f0-4c1b-8ce3-ffc532847b98 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:06.035106 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-55ba9b45-b7f0-4c1b-8ce3-ffc532847b98 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:06.046012 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-55ba9b45-b7f0-4c1b-8ce3-ffc532847b98 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:06.048462 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-55ba9b45-b7f0-4c1b-8ce3-ffc532847b98 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:06.060209 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-55ba9b45-b7f0-4c1b-8ce3-ffc532847b98 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:06.060801 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-55ba9b45-b7f0-4c1b-8ce3-ffc532847b98 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:06.095085 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ad972ac0-dbed-41d3-be6e-c7012f3d679b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:06.103510 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-ad972ac0-dbed-41d3-be6e-c7012f3d679b tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1554 microversion: 2.1 time: 0.236273 Feb 08 16:43:06.105311 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 135/268] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:05 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1554 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:06.268499 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-55ba9b45-b7f0-4c1b-8ce3-ffc532847b98 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:06.279376 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-55ba9b45-b7f0-4c1b-8ce3-ffc532847b98 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.248096 Feb 08 16:43:06.288275 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 134/269] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:06 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:07.121638 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-4b39f593-f18b-4a4a-981a-a7e661617543 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:07.122848 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-4b39f593-f18b-4a4a-981a-a7e661617543 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:07.129576 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4b39f593-f18b-4a4a-981a-a7e661617543 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:07.130031 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4b39f593-f18b-4a4a-981a-a7e661617543 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:07.131148 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4b39f593-f18b-4a4a-981a-a7e661617543 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:07.131779 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4b39f593-f18b-4a4a-981a-a7e661617543 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:07.295902 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-832594d2-9c17-48fb-b78e-d02d891710b0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:07.297217 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-832594d2-9c17-48fb-b78e-d02d891710b0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:07.299405 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-4b39f593-f18b-4a4a-981a-a7e661617543 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:07.303286 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-832594d2-9c17-48fb-b78e-d02d891710b0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:07.303729 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-832594d2-9c17-48fb-b78e-d02d891710b0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:07.305471 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-832594d2-9c17-48fb-b78e-d02d891710b0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:07.305903 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-832594d2-9c17-48fb-b78e-d02d891710b0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:07.314148 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-4b39f593-f18b-4a4a-981a-a7e661617543 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1554 microversion: 2.1 time: 0.196167 Feb 08 16:43:07.314736 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 136/270] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:07 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1554 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:07.614438 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-832594d2-9c17-48fb-b78e-d02d891710b0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:07.622121 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-832594d2-9c17-48fb-b78e-d02d891710b0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.329663 Feb 08 16:43:07.622818 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 135/271] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:07 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:07.762665 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-3fa2c0d4-9d8c-4a4e-8e53-c1b524f0c540 req-b78818c8-9613-4950-bfc1-74b416e0d374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ba1bca6-d50c-4032-809e-46b9ecbbf304", "name": "network-vif-deleted", "tag": "8ada1591-1e3d-4284-b7ae-9c7a774e81b8"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:43:07.764551 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:43:07.764551 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:43:07.773026 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-3fa2c0d4-9d8c-4a4e-8e53-c1b524f0c540 req-b78818c8-9613-4950-bfc1-74b416e0d374 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:07.773304 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-3fa2c0d4-9d8c-4a4e-8e53-c1b524f0c540 req-b78818c8-9613-4950-bfc1-74b416e0d374 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:07.784364 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-3fa2c0d4-9d8c-4a4e-8e53-c1b524f0c540 req-b78818c8-9613-4950-bfc1-74b416e0d374 service nova] Creating event network-vif-deleted:8ada1591-1e3d-4284-b7ae-9c7a774e81b8 for instance 4ba1bca6-d50c-4032-809e-46b9ecbbf304 on hv-cinder-82786 Feb 08 16:43:07.791555 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-3fa2c0d4-9d8c-4a4e-8e53-c1b524f0c540 req-b78818c8-9613-4950-bfc1-74b416e0d374 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032556 Feb 08 16:43:07.792383 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 137/272] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:43:08.330889 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-6bd86bb4-49c4-4556-aee5-0d9b4c2619e5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:08.331495 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-6bd86bb4-49c4-4556-aee5-0d9b4c2619e5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:08.337893 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6bd86bb4-49c4-4556-aee5-0d9b4c2619e5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:08.338335 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6bd86bb4-49c4-4556-aee5-0d9b4c2619e5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:08.339110 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6bd86bb4-49c4-4556-aee5-0d9b4c2619e5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:08.339538 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6bd86bb4-49c4-4556-aee5-0d9b4c2619e5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:08.373537 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6bd86bb4-49c4-4556-aee5-0d9b4c2619e5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:08.373982 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6bd86bb4-49c4-4556-aee5-0d9b4c2619e5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:08.374439 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.objects.instance [None req-6bd86bb4-49c4-4556-aee5-0d9b4c2619e5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lazy-loading 'fault' on Instance uuid 4ba1bca6-d50c-4032-809e-46b9ecbbf304 {{(pid=122901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:43:08.429597 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-6bd86bb4-49c4-4556-aee5-0d9b4c2619e5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b846098f335a42e0892f7f35007ef234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcf2a29fa234f62a1c82620e2c1cbcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:08.437948 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-6bd86bb4-49c4-4556-aee5-0d9b4c2619e5 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 200 len: 1351 microversion: 2.1 time: 0.110706 Feb 08 16:43:08.438533 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 136/273] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:08 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 1351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:08.576615 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-0b6c576c-ffbd-4cbe-9b9e-47fa0bc7a6db tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-473274671", "imageRef": "d70d3911-14f2-4cba-9283-bf4bef4fb526", "flavorRef": "452"}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:43:08.643830 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-69f4680f-0c89-47c1-9985-b7870ac6df3c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:08.644670 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-69f4680f-0c89-47c1-9985-b7870ac6df3c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:08.648831 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.network.neutron [None req-0b6c576c-ffbd-4cbe-9b9e-47fa0bc7a6db tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] validate_networks() for None {{(pid=122902) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 16:43:08.654987 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-69f4680f-0c89-47c1-9985-b7870ac6df3c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:08.655478 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-69f4680f-0c89-47c1-9985-b7870ac6df3c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:08.656651 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-69f4680f-0c89-47c1-9985-b7870ac6df3c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:08.657253 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-69f4680f-0c89-47c1-9985-b7870ac6df3c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:08.929711 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-69f4680f-0c89-47c1-9985-b7870ac6df3c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:08.937684 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-69f4680f-0c89-47c1-9985-b7870ac6df3c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.298317 Feb 08 16:43:08.938784 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 137/274] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:08 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:08.983711 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-0b6c576c-ffbd-4cbe-9b9e-47fa0bc7a6db tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Flavor limits 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 16:43:08.984158 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-0b6c576c-ffbd-4cbe-9b9e-47fa0bc7a6db tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Image limits 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 16:43:08.984649 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-0b6c576c-ffbd-4cbe-9b9e-47fa0bc7a6db tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Flavor pref 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 16:43:08.985051 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-0b6c576c-ffbd-4cbe-9b9e-47fa0bc7a6db tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Image pref 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 16:43:08.985458 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-0b6c576c-ffbd-4cbe-9b9e-47fa0bc7a6db tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 16:43:08.995640 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0b6c576c-ffbd-4cbe-9b9e-47fa0bc7a6db tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:08.997260 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0b6c576c-ffbd-4cbe-9b9e-47fa0bc7a6db tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:08.998494 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0b6c576c-ffbd-4cbe-9b9e-47fa0bc7a6db tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:08.998939 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0b6c576c-ffbd-4cbe-9b9e-47fa0bc7a6db tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:09.016686 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-0b6c576c-ffbd-4cbe-9b9e-47fa0bc7a6db tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Getting quotas for project 82109ab07882467bb75fe01c154fbbb5. Resources: {'cores', 'ram', 'instances'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:43:09.020999 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-0b6c576c-ffbd-4cbe-9b9e-47fa0bc7a6db tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Getting quotas for user d82f340df87346cea3eb5a091d93d3ee and project 82109ab07882467bb75fe01c154fbbb5. Resources: {'cores', 'ram', 'instances'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:43:09.032717 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-0b6c576c-ffbd-4cbe-9b9e-47fa0bc7a6db tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Going to run 1 instances... {{(pid=122902) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 16:43:09.035095 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-0b6c576c-ffbd-4cbe-9b9e-47fa0bc7a6db tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d70d3911-14f2-4cba-9283-bf4bef4fb526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 16:43:09.084630 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-0b6c576c-ffbd-4cbe-9b9e-47fa0bc7a6db tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.513980 Feb 08 16:43:09.085773 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 138/275] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Feb 8 16:43:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 16:43:09.097419 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-572b338b-0f68-42a6-9e8c-302c1e81549b tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:09.098428 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-572b338b-0f68-42a6-9e8c-302c1e81549b tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:09.176257 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-572b338b-0f68-42a6-9e8c-302c1e81549b tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f340df87346cea3eb5a091d93d3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82109ab07882467bb75fe01c154fbbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:09.188681 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-572b338b-0f68-42a6-9e8c-302c1e81549b tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] 10.222.0.35 "GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21" status: 200 len: 1214 microversion: 2.1 time: 0.096221 Feb 08 16:43:09.199664 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 138/276] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:09 2022] GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:09.455537 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-cd12adbd-b8e6-4af2-871e-501c8684ab7d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:09.456258 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-cd12adbd-b8e6-4af2-871e-501c8684ab7d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:09.463214 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cd12adbd-b8e6-4af2-871e-501c8684ab7d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:09.463672 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cd12adbd-b8e6-4af2-871e-501c8684ab7d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:09.464624 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cd12adbd-b8e6-4af2-871e-501c8684ab7d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:09.465248 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cd12adbd-b8e6-4af2-871e-501c8684ab7d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:09.479493 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-cd12adbd-b8e6-4af2-871e-501c8684ab7d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] HTTP exception thrown: Instance 4ba1bca6-d50c-4032-809e-46b9ecbbf304 could not be found. Feb 08 16:43:09.480359 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-cd12adbd-b8e6-4af2-871e-501c8684ab7d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Returning 404 to user: Instance 4ba1bca6-d50c-4032-809e-46b9ecbbf304 could not be found. {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:43:09.484554 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-cd12adbd-b8e6-4af2-871e-501c8684ab7d tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 404 len: 111 microversion: 2.1 time: 0.030622 Feb 08 16:43:09.486172 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 139/277] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:09 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:43:09.606772 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-cfcb62d7-9992-4b21-8918-4bfd7480b633 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:09.607849 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-cfcb62d7-9992-4b21-8918-4bfd7480b633 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:09.614279 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cfcb62d7-9992-4b21-8918-4bfd7480b633 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:09.614730 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cfcb62d7-9992-4b21-8918-4bfd7480b633 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:09.615713 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cfcb62d7-9992-4b21-8918-4bfd7480b633 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:09.616191 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cfcb62d7-9992-4b21-8918-4bfd7480b633 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:09.650069 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.wsgi [None req-cfcb62d7-9992-4b21-8918-4bfd7480b633 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] HTTP exception thrown: Instance 4ba1bca6-d50c-4032-809e-46b9ecbbf304 could not be found. Feb 08 16:43:09.650707 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-cfcb62d7-9992-4b21-8918-4bfd7480b633 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Returning 404 to user: Instance 4ba1bca6-d50c-4032-809e-46b9ecbbf304 could not be found. {{(pid=122901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:43:09.651733 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-cfcb62d7-9992-4b21-8918-4bfd7480b633 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.048797 Feb 08 16:43:09.652572 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 139/278] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:43:09 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304/os-volume_attachments => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:43:09.954707 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-d41dcc04-62eb-4cf1-bdbe-0d5812f3b116 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:09.955331 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-d41dcc04-62eb-4cf1-bdbe-0d5812f3b116 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:09.961823 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d41dcc04-62eb-4cf1-bdbe-0d5812f3b116 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:09.962267 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d41dcc04-62eb-4cf1-bdbe-0d5812f3b116 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:09.963035 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d41dcc04-62eb-4cf1-bdbe-0d5812f3b116 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:09.963465 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d41dcc04-62eb-4cf1-bdbe-0d5812f3b116 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:10.095874 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-d41dcc04-62eb-4cf1-bdbe-0d5812f3b116 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:10.103528 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-d41dcc04-62eb-4cf1-bdbe-0d5812f3b116 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.152384 Feb 08 16:43:10.104059 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 140/279] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:09 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:10.205859 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-045cecd5-df18-4d37-bf1b-bcd1dc9f4346 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:10.206465 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-045cecd5-df18-4d37-bf1b-bcd1dc9f4346 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:10.212896 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-045cecd5-df18-4d37-bf1b-bcd1dc9f4346 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:10.213783 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-045cecd5-df18-4d37-bf1b-bcd1dc9f4346 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:10.215107 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-045cecd5-df18-4d37-bf1b-bcd1dc9f4346 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:10.215631 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-045cecd5-df18-4d37-bf1b-bcd1dc9f4346 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:10.312732 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-045cecd5-df18-4d37-bf1b-bcd1dc9f4346 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f340df87346cea3eb5a091d93d3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82109ab07882467bb75fe01c154fbbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:10.326061 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-045cecd5-df18-4d37-bf1b-bcd1dc9f4346 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] 10.222.0.35 "GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21" status: 200 len: 1274 microversion: 2.1 time: 0.123661 Feb 08 16:43:10.328296 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 140/280] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:10 2022] GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21 => generated 1274 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:10.911703 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-6f56691b-c65a-4fbb-9dba-93898e18e519 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:10.912244 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-6f56691b-c65a-4fbb-9dba-93898e18e519 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:10.918614 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6f56691b-c65a-4fbb-9dba-93898e18e519 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:10.919060 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6f56691b-c65a-4fbb-9dba-93898e18e519 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:10.919860 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6f56691b-c65a-4fbb-9dba-93898e18e519 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:10.920290 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6f56691b-c65a-4fbb-9dba-93898e18e519 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:10.933288 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-6f56691b-c65a-4fbb-9dba-93898e18e519 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] HTTP exception thrown: Instance 4ba1bca6-d50c-4032-809e-46b9ecbbf304 could not be found. Feb 08 16:43:10.933877 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-6f56691b-c65a-4fbb-9dba-93898e18e519 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Returning 404 to user: Instance 4ba1bca6-d50c-4032-809e-46b9ecbbf304 could not be found. {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:43:10.934696 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-6f56691b-c65a-4fbb-9dba-93898e18e519 tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "DELETE /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 404 len: 111 microversion: 2.1 time: 0.026637 Feb 08 16:43:10.935245 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 141/281] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Feb 8 16:43:10 2022] DELETE /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:43:10.943650 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-5a446fd6-96aa-41a8-a479-c1d3c61647cf tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:10.944292 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-5a446fd6-96aa-41a8-a479-c1d3c61647cf tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] [instance: 4ba1bca6-d50c-4032-809e-46b9ecbbf304] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:10.951013 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5a446fd6-96aa-41a8-a479-c1d3c61647cf tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:10.951470 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5a446fd6-96aa-41a8-a479-c1d3c61647cf tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:10.952352 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5a446fd6-96aa-41a8-a479-c1d3c61647cf tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:10.952789 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5a446fd6-96aa-41a8-a479-c1d3c61647cf tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:10.967187 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.wsgi [None req-5a446fd6-96aa-41a8-a479-c1d3c61647cf tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] HTTP exception thrown: Instance 4ba1bca6-d50c-4032-809e-46b9ecbbf304 could not be found. Feb 08 16:43:10.967819 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-5a446fd6-96aa-41a8-a479-c1d3c61647cf tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] Returning 404 to user: Instance 4ba1bca6-d50c-4032-809e-46b9ecbbf304 could not be found. {{(pid=122901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:43:10.968656 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-5a446fd6-96aa-41a8-a479-c1d3c61647cf tempest-DeleteServersTestJSON-827669345 tempest-DeleteServersTestJSON-827669345-project] 10.222.0.35 "GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304" status: 404 len: 111 microversion: 2.1 time: 0.029432 Feb 08 16:43:10.969215 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 141/282] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:10 2022] GET /compute/v2.1/servers/4ba1bca6-d50c-4032-809e-46b9ecbbf304 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 08 16:43:11.122752 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-9c5b309a-0b1d-4e38-bc1f-9ae124f118ea tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:11.125366 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-9c5b309a-0b1d-4e38-bc1f-9ae124f118ea tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:11.135544 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9c5b309a-0b1d-4e38-bc1f-9ae124f118ea tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:11.136183 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9c5b309a-0b1d-4e38-bc1f-9ae124f118ea tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:11.137184 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9c5b309a-0b1d-4e38-bc1f-9ae124f118ea tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:11.137557 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9c5b309a-0b1d-4e38-bc1f-9ae124f118ea tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:11.346692 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-39e4a75a-0429-4ad5-8c0c-e01a90f43990 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:11.347444 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-39e4a75a-0429-4ad5-8c0c-e01a90f43990 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:11.356264 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-39e4a75a-0429-4ad5-8c0c-e01a90f43990 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:11.356988 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-39e4a75a-0429-4ad5-8c0c-e01a90f43990 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:11.358167 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-39e4a75a-0429-4ad5-8c0c-e01a90f43990 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:11.358841 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-39e4a75a-0429-4ad5-8c0c-e01a90f43990 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:11.450365 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9c5b309a-0b1d-4e38-bc1f-9ae124f118ea tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:11.465018 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-9c5b309a-0b1d-4e38-bc1f-9ae124f118ea tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.347482 Feb 08 16:43:11.465600 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 142/283] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:11 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:11.603782 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-39e4a75a-0429-4ad5-8c0c-e01a90f43990 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f340df87346cea3eb5a091d93d3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82109ab07882467bb75fe01c154fbbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:11.610982 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-39e4a75a-0429-4ad5-8c0c-e01a90f43990 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] 10.222.0.35 "GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21" status: 200 len: 1314 microversion: 2.1 time: 0.269681 Feb 08 16:43:11.611543 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 142/284] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:11 2022] GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:11.966245 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-bde76d1f-4741-41d7-a446-52ea637c91e2 req-4348c996-418e-4c21-89e7-deb2468053e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd2d934f-5925-4055-9b52-388a201fea21", "tag": "8fdd6258-0b21-4ea1-a254-24490bc5a5c6"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:43:11.968396 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:43:11.968396 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:43:11.982228 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-bde76d1f-4741-41d7-a446-52ea637c91e2 req-4348c996-418e-4c21-89e7-deb2468053e3 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:11.982889 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-bde76d1f-4741-41d7-a446-52ea637c91e2 req-4348c996-418e-4c21-89e7-deb2468053e3 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:11.998581 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-bde76d1f-4741-41d7-a446-52ea637c91e2 req-4348c996-418e-4c21-89e7-deb2468053e3 service nova] Creating event network-changed:8fdd6258-0b21-4ea1-a254-24490bc5a5c6 for instance fd2d934f-5925-4055-9b52-388a201fea21 on hv-cinder-82786 Feb 08 16:43:12.006582 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-bde76d1f-4741-41d7-a446-52ea637c91e2 req-4348c996-418e-4c21-89e7-deb2468053e3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046314 Feb 08 16:43:12.010714 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 143/285] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:43:12.488909 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-346c7eea-f6e1-4878-8d73-dfb219025803 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:12.490189 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-346c7eea-f6e1-4878-8d73-dfb219025803 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:12.498974 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-346c7eea-f6e1-4878-8d73-dfb219025803 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:12.499653 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-346c7eea-f6e1-4878-8d73-dfb219025803 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:12.500490 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-346c7eea-f6e1-4878-8d73-dfb219025803 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:12.500924 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-346c7eea-f6e1-4878-8d73-dfb219025803 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:12.635612 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e8353554-3734-415d-bb8c-56822f8a93e8 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:12.641707 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e8353554-3734-415d-bb8c-56822f8a93e8 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:12.653369 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e8353554-3734-415d-bb8c-56822f8a93e8 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:12.654014 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e8353554-3734-415d-bb8c-56822f8a93e8 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:12.654911 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e8353554-3734-415d-bb8c-56822f8a93e8 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:12.655448 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e8353554-3734-415d-bb8c-56822f8a93e8 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:12.820771 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e8353554-3734-415d-bb8c-56822f8a93e8 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f340df87346cea3eb5a091d93d3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82109ab07882467bb75fe01c154fbbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:12.829742 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e8353554-3734-415d-bb8c-56822f8a93e8 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] 10.222.0.35 "GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21" status: 200 len: 1314 microversion: 2.1 time: 0.205122 Feb 08 16:43:12.831449 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 144/286] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:12 2022] GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:12.917939 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-346c7eea-f6e1-4878-8d73-dfb219025803 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:12.933363 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-346c7eea-f6e1-4878-8d73-dfb219025803 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.453515 Feb 08 16:43:12.934204 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 143/287] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:12 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:13.846558 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-67000615-99b9-450e-bade-a0f9fbcfc853 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:13.847175 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-67000615-99b9-450e-bade-a0f9fbcfc853 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:13.853379 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-67000615-99b9-450e-bade-a0f9fbcfc853 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:13.853663 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-67000615-99b9-450e-bade-a0f9fbcfc853 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:13.854447 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-67000615-99b9-450e-bade-a0f9fbcfc853 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:13.854952 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-67000615-99b9-450e-bade-a0f9fbcfc853 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:13.950693 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-51fd406c-c29a-44c5-a7d2-5dfd51236661 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:13.951287 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-51fd406c-c29a-44c5-a7d2-5dfd51236661 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:13.957564 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-51fd406c-c29a-44c5-a7d2-5dfd51236661 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:13.958250 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-51fd406c-c29a-44c5-a7d2-5dfd51236661 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:13.959330 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-51fd406c-c29a-44c5-a7d2-5dfd51236661 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:13.959976 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-51fd406c-c29a-44c5-a7d2-5dfd51236661 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:14.028007 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-67000615-99b9-450e-bade-a0f9fbcfc853 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f340df87346cea3eb5a091d93d3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82109ab07882467bb75fe01c154fbbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:14.035649 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-67000615-99b9-450e-bade-a0f9fbcfc853 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] 10.222.0.35 "GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21" status: 200 len: 1314 microversion: 2.1 time: 0.192594 Feb 08 16:43:14.036461 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 145/288] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:13 2022] GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:14.143731 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-51fd406c-c29a-44c5-a7d2-5dfd51236661 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:14.152413 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-51fd406c-c29a-44c5-a7d2-5dfd51236661 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.205902 Feb 08 16:43:14.153203 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 144/289] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:13 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:14.340474 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-59d6fee4-eaff-4fa0-8376-f57a7a1cc422 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1128694694", "imageRef": "d70d3911-14f2-4cba-9283-bf4bef4fb526", "flavorRef": "452", "networks": [{"uuid": "ec8f7fac-5fb6-486d-81c6-a643c1dc738e"}]}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:43:14.394216 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.network.neutron [None req-59d6fee4-eaff-4fa0-8376-f57a7a1cc422 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] validate_networks() for [('ec8f7fac-5fb6-486d-81c6-a643c1dc738e', None, None, None, None, None)] {{(pid=122902) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 16:43:14.745843 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-59d6fee4-eaff-4fa0-8376-f57a7a1cc422 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Flavor limits 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 16:43:14.746458 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-59d6fee4-eaff-4fa0-8376-f57a7a1cc422 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Image limits 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 16:43:14.746937 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-59d6fee4-eaff-4fa0-8376-f57a7a1cc422 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Flavor pref 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 16:43:14.747345 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-59d6fee4-eaff-4fa0-8376-f57a7a1cc422 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Image pref 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 16:43:14.747941 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-59d6fee4-eaff-4fa0-8376-f57a7a1cc422 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 16:43:14.758523 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-59d6fee4-eaff-4fa0-8376-f57a7a1cc422 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:14.758979 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-59d6fee4-eaff-4fa0-8376-f57a7a1cc422 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:14.760128 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-59d6fee4-eaff-4fa0-8376-f57a7a1cc422 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:14.760813 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-59d6fee4-eaff-4fa0-8376-f57a7a1cc422 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:14.779659 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-59d6fee4-eaff-4fa0-8376-f57a7a1cc422 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Getting quotas for project 3b57fcb90a594af1b70daaecbf9efd96. Resources: {'cores', 'ram', 'instances'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:43:14.784117 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-59d6fee4-eaff-4fa0-8376-f57a7a1cc422 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Getting quotas for user a5eff85a200a4a599e0cefe8d681d72d and project 3b57fcb90a594af1b70daaecbf9efd96. Resources: {'cores', 'ram', 'instances'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:43:14.795123 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-59d6fee4-eaff-4fa0-8376-f57a7a1cc422 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Going to run 1 instances... {{(pid=122902) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 16:43:14.797603 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-59d6fee4-eaff-4fa0-8376-f57a7a1cc422 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d70d3911-14f2-4cba-9283-bf4bef4fb526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 16:43:14.846695 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-59d6fee4-eaff-4fa0-8376-f57a7a1cc422 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616746 Feb 08 16:43:14.847704 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 146/290] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Feb 8 16:43:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 16:43:14.858613 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-863e4edd-f29e-4209-86ac-3851abb5b351 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:14.859931 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-863e4edd-f29e-4209-86ac-3851abb5b351 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:14.917665 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-863e4edd-f29e-4209-86ac-3851abb5b351 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:14.924249 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-863e4edd-f29e-4209-86ac-3851abb5b351 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1218 microversion: 2.1 time: 0.069479 Feb 08 16:43:14.925459 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 145/291] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:14 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:15.052638 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e024a75c-3298-4692-a30e-89dea39c8fe5 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:15.053256 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e024a75c-3298-4692-a30e-89dea39c8fe5 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:15.060869 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e024a75c-3298-4692-a30e-89dea39c8fe5 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:15.061341 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e024a75c-3298-4692-a30e-89dea39c8fe5 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:15.062125 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e024a75c-3298-4692-a30e-89dea39c8fe5 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:15.062720 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e024a75c-3298-4692-a30e-89dea39c8fe5 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:15.170694 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-632d02fb-d83f-401a-8efa-3380b52ca1ab tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:15.172068 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-632d02fb-d83f-401a-8efa-3380b52ca1ab tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:15.178629 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-632d02fb-d83f-401a-8efa-3380b52ca1ab tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:15.179329 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-632d02fb-d83f-401a-8efa-3380b52ca1ab tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:15.180546 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-632d02fb-d83f-401a-8efa-3380b52ca1ab tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:15.181793 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-632d02fb-d83f-401a-8efa-3380b52ca1ab tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:15.218098 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e024a75c-3298-4692-a30e-89dea39c8fe5 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f340df87346cea3eb5a091d93d3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82109ab07882467bb75fe01c154fbbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:15.226993 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e024a75c-3298-4692-a30e-89dea39c8fe5 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] 10.222.0.35 "GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21" status: 200 len: 1314 microversion: 2.1 time: 0.177832 Feb 08 16:43:15.232706 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 147/292] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:15 2022] GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:15.342719 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-632d02fb-d83f-401a-8efa-3380b52ca1ab tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:15.358543 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-632d02fb-d83f-401a-8efa-3380b52ca1ab tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.192302 Feb 08 16:43:15.360473 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 146/293] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:15 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:15.944686 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-2eeb1bd8-a203-48d0-b430-dcad81f875e4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:15.946030 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-2eeb1bd8-a203-48d0-b430-dcad81f875e4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:15.953927 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2eeb1bd8-a203-48d0-b430-dcad81f875e4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:15.954765 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2eeb1bd8-a203-48d0-b430-dcad81f875e4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:15.955992 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2eeb1bd8-a203-48d0-b430-dcad81f875e4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:15.956927 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2eeb1bd8-a203-48d0-b430-dcad81f875e4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:16.250761 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-9cbe34fd-ae39-4653-a32a-5ed13a1c42c1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:16.252238 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-9cbe34fd-ae39-4653-a32a-5ed13a1c42c1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:16.269800 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9cbe34fd-ae39-4653-a32a-5ed13a1c42c1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:16.269800 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9cbe34fd-ae39-4653-a32a-5ed13a1c42c1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:16.269800 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9cbe34fd-ae39-4653-a32a-5ed13a1c42c1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:16.269800 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9cbe34fd-ae39-4653-a32a-5ed13a1c42c1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:16.330502 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-2eeb1bd8-a203-48d0-b430-dcad81f875e4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:16.343232 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-2eeb1bd8-a203-48d0-b430-dcad81f875e4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1278 microversion: 2.1 time: 0.404866 Feb 08 16:43:16.344393 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 148/294] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:15 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1278 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:16.377388 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-6ea2fe7c-c35c-45a7-afde-1e302122287a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:16.378000 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-6ea2fe7c-c35c-45a7-afde-1e302122287a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:16.384185 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6ea2fe7c-c35c-45a7-afde-1e302122287a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:16.385126 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6ea2fe7c-c35c-45a7-afde-1e302122287a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:16.385941 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6ea2fe7c-c35c-45a7-afde-1e302122287a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:16.386377 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6ea2fe7c-c35c-45a7-afde-1e302122287a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:16.529797 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-6ea2fe7c-c35c-45a7-afde-1e302122287a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:16.538268 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-6ea2fe7c-c35c-45a7-afde-1e302122287a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.165005 Feb 08 16:43:16.539042 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 149/295] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:16 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:16.552960 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-9cbe34fd-ae39-4653-a32a-5ed13a1c42c1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f340df87346cea3eb5a091d93d3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82109ab07882467bb75fe01c154fbbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:16.561387 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-9cbe34fd-ae39-4653-a32a-5ed13a1c42c1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] 10.222.0.35 "GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21" status: 200 len: 1314 microversion: 2.1 time: 0.315956 Feb 08 16:43:16.562319 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 147/296] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:16 2022] GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:17.360773 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-d24b13b2-191d-4387-9d25-526cc3da1290 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:17.362925 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-d24b13b2-191d-4387-9d25-526cc3da1290 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:17.374082 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-ca0b6cab-26dc-4527-b6c2-b7eba3a064d1 req-59a406d6-835b-4533-a432-3d10344dd2d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "547dd9a2-9f3b-49f5-a2f7-34e5283b9aed", "tag": "6d242b95-699b-413d-9b89-1b82e91da648"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:43:17.376267 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:43:17.376267 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:43:17.384862 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-ca0b6cab-26dc-4527-b6c2-b7eba3a064d1 req-59a406d6-835b-4533-a432-3d10344dd2d1 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:17.385393 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-ca0b6cab-26dc-4527-b6c2-b7eba3a064d1 req-59a406d6-835b-4533-a432-3d10344dd2d1 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:17.388461 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d24b13b2-191d-4387-9d25-526cc3da1290 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:17.389141 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d24b13b2-191d-4387-9d25-526cc3da1290 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:17.389944 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d24b13b2-191d-4387-9d25-526cc3da1290 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:17.390379 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d24b13b2-191d-4387-9d25-526cc3da1290 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:17.397637 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-ca0b6cab-26dc-4527-b6c2-b7eba3a064d1 req-59a406d6-835b-4533-a432-3d10344dd2d1 service nova] Creating event network-changed:6d242b95-699b-413d-9b89-1b82e91da648 for instance 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed on hv-cinder-82786 Feb 08 16:43:17.403683 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-ca0b6cab-26dc-4527-b6c2-b7eba3a064d1 req-59a406d6-835b-4533-a432-3d10344dd2d1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034710 Feb 08 16:43:17.404377 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 148/297] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:43:17.523740 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-d24b13b2-191d-4387-9d25-526cc3da1290 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:17.531795 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-d24b13b2-191d-4387-9d25-526cc3da1290 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1318 microversion: 2.1 time: 0.175366 Feb 08 16:43:17.532371 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 150/298] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:17 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:17.557146 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-4cc8b3ce-9bac-45e1-831d-1886d832fc1a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:17.557852 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4cc8b3ce-9bac-45e1-831d-1886d832fc1a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:17.564007 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4cc8b3ce-9bac-45e1-831d-1886d832fc1a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:17.564457 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4cc8b3ce-9bac-45e1-831d-1886d832fc1a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:17.565241 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4cc8b3ce-9bac-45e1-831d-1886d832fc1a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:17.565683 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4cc8b3ce-9bac-45e1-831d-1886d832fc1a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:17.578505 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-bcc8966e-8192-45a2-8184-42b410b943b4 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:17.579037 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-bcc8966e-8192-45a2-8184-42b410b943b4 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:17.585271 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bcc8966e-8192-45a2-8184-42b410b943b4 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:17.585714 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bcc8966e-8192-45a2-8184-42b410b943b4 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:17.589175 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bcc8966e-8192-45a2-8184-42b410b943b4 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:17.589175 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bcc8966e-8192-45a2-8184-42b410b943b4 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:17.711372 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4cc8b3ce-9bac-45e1-831d-1886d832fc1a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:17.717952 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-bcc8966e-8192-45a2-8184-42b410b943b4 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f340df87346cea3eb5a091d93d3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82109ab07882467bb75fe01c154fbbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:17.719581 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-4cc8b3ce-9bac-45e1-831d-1886d832fc1a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.167375 Feb 08 16:43:17.720185 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 149/299] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:17 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:17.725190 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-bcc8966e-8192-45a2-8184-42b410b943b4 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] 10.222.0.35 "GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21" status: 200 len: 1314 microversion: 2.1 time: 0.150450 Feb 08 16:43:17.725750 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 151/300] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:17 2022] GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:18.548518 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d56fc1b3-539f-47c6-bf28-1d702c0dc19a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:18.549121 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-d56fc1b3-539f-47c6-bf28-1d702c0dc19a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:18.555323 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d56fc1b3-539f-47c6-bf28-1d702c0dc19a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:18.555907 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d56fc1b3-539f-47c6-bf28-1d702c0dc19a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:18.556791 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d56fc1b3-539f-47c6-bf28-1d702c0dc19a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:18.557246 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d56fc1b3-539f-47c6-bf28-1d702c0dc19a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:18.689250 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d56fc1b3-539f-47c6-bf28-1d702c0dc19a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:18.696927 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d56fc1b3-539f-47c6-bf28-1d702c0dc19a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1318 microversion: 2.1 time: 0.151569 Feb 08 16:43:18.697496 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 150/301] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:18 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:18.736073 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-124b2566-548c-4252-be5f-d84d5cc14c79 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:18.736678 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-124b2566-548c-4252-be5f-d84d5cc14c79 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:18.741342 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-7e643602-d593-4f7f-865c-b561902e21e1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:18.742085 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7e643602-d593-4f7f-865c-b561902e21e1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:18.742505 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-124b2566-548c-4252-be5f-d84d5cc14c79 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:18.742982 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-124b2566-548c-4252-be5f-d84d5cc14c79 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:18.744042 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-124b2566-548c-4252-be5f-d84d5cc14c79 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:18.744531 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-124b2566-548c-4252-be5f-d84d5cc14c79 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:18.747987 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7e643602-d593-4f7f-865c-b561902e21e1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:18.748430 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7e643602-d593-4f7f-865c-b561902e21e1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:18.749202 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7e643602-d593-4f7f-865c-b561902e21e1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:18.749632 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7e643602-d593-4f7f-865c-b561902e21e1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:18.878472 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-124b2566-548c-4252-be5f-d84d5cc14c79 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:18.882858 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7e643602-d593-4f7f-865c-b561902e21e1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f340df87346cea3eb5a091d93d3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82109ab07882467bb75fe01c154fbbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:18.887309 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-124b2566-548c-4252-be5f-d84d5cc14c79 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.154791 Feb 08 16:43:18.887992 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 152/302] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:18 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:18.890763 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-7e643602-d593-4f7f-865c-b561902e21e1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] 10.222.0.35 "GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21" status: 200 len: 1314 microversion: 2.1 time: 0.152829 Feb 08 16:43:18.891310 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 151/303] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:18 2022] GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:19.713721 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-fcb44690-95df-4504-9283-ba27e6efdaad tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:19.714247 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-fcb44690-95df-4504-9283-ba27e6efdaad tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:19.720498 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fcb44690-95df-4504-9283-ba27e6efdaad tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:19.720946 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fcb44690-95df-4504-9283-ba27e6efdaad tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:19.721720 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fcb44690-95df-4504-9283-ba27e6efdaad tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:19.722152 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fcb44690-95df-4504-9283-ba27e6efdaad tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:19.857403 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-fcb44690-95df-4504-9283-ba27e6efdaad tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:19.864742 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-fcb44690-95df-4504-9283-ba27e6efdaad tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1318 microversion: 2.1 time: 0.155221 Feb 08 16:43:19.865293 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 153/304] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:19 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:19.904534 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-1cbd8c66-c6e9-4646-ab7a-05f1f1284d34 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:19.905138 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-1cbd8c66-c6e9-4646-ab7a-05f1f1284d34 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:19.907446 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-a321953a-b786-4a54-b033-5359a2c1a48d tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:19.908100 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-a321953a-b786-4a54-b033-5359a2c1a48d tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:19.911354 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1cbd8c66-c6e9-4646-ab7a-05f1f1284d34 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:19.911818 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1cbd8c66-c6e9-4646-ab7a-05f1f1284d34 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:19.912595 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1cbd8c66-c6e9-4646-ab7a-05f1f1284d34 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:19.913045 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1cbd8c66-c6e9-4646-ab7a-05f1f1284d34 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:19.913838 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a321953a-b786-4a54-b033-5359a2c1a48d tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:19.914287 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a321953a-b786-4a54-b033-5359a2c1a48d tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:19.915066 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a321953a-b786-4a54-b033-5359a2c1a48d tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:19.916240 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a321953a-b786-4a54-b033-5359a2c1a48d tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:20.047713 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-a321953a-b786-4a54-b033-5359a2c1a48d tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f340df87346cea3eb5a091d93d3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82109ab07882467bb75fe01c154fbbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:20.047875 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-1cbd8c66-c6e9-4646-ab7a-05f1f1284d34 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:20.055124 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-a321953a-b786-4a54-b033-5359a2c1a48d tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] 10.222.0.35 "GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21" status: 200 len: 1314 microversion: 2.1 time: 0.151210 Feb 08 16:43:20.055279 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-1cbd8c66-c6e9-4646-ab7a-05f1f1284d34 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.154448 Feb 08 16:43:20.055705 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 152/305] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:19 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:20.056932 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 154/306] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:19 2022] GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:20.881484 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-cffeb610-500e-475e-b5f0-e4a92386ba50 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:20.881907 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-cffeb610-500e-475e-b5f0-e4a92386ba50 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:20.888593 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cffeb610-500e-475e-b5f0-e4a92386ba50 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:20.889049 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cffeb610-500e-475e-b5f0-e4a92386ba50 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:20.889831 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cffeb610-500e-475e-b5f0-e4a92386ba50 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:20.890272 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cffeb610-500e-475e-b5f0-e4a92386ba50 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:21.019323 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-cffeb610-500e-475e-b5f0-e4a92386ba50 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:21.026560 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-cffeb610-500e-475e-b5f0-e4a92386ba50 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1318 microversion: 2.1 time: 0.149168 Feb 08 16:43:21.027121 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 153/307] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:20 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:21.070981 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-fc23d9dd-87ab-4984-b304-cebe6af4d06f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:21.071775 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ac5a8a12-f84a-4fb6-b5e7-88fbc8097fff tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:21.071882 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-fc23d9dd-87ab-4984-b304-cebe6af4d06f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:21.072538 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-ac5a8a12-f84a-4fb6-b5e7-88fbc8097fff tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:21.077813 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fc23d9dd-87ab-4984-b304-cebe6af4d06f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:21.078327 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fc23d9dd-87ab-4984-b304-cebe6af4d06f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:21.078431 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ac5a8a12-f84a-4fb6-b5e7-88fbc8097fff tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:21.078795 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ac5a8a12-f84a-4fb6-b5e7-88fbc8097fff tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:21.079337 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fc23d9dd-87ab-4984-b304-cebe6af4d06f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:21.079719 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ac5a8a12-f84a-4fb6-b5e7-88fbc8097fff tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:21.079868 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fc23d9dd-87ab-4984-b304-cebe6af4d06f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:21.080182 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ac5a8a12-f84a-4fb6-b5e7-88fbc8097fff tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:21.215799 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ac5a8a12-f84a-4fb6-b5e7-88fbc8097fff tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f340df87346cea3eb5a091d93d3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82109ab07882467bb75fe01c154fbbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:21.215984 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-fc23d9dd-87ab-4984-b304-cebe6af4d06f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:21.223090 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-fc23d9dd-87ab-4984-b304-cebe6af4d06f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.155740 Feb 08 16:43:21.223473 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-ac5a8a12-f84a-4fb6-b5e7-88fbc8097fff tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] 10.222.0.35 "GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21" status: 200 len: 1314 microversion: 2.1 time: 0.155150 Feb 08 16:43:21.223959 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 155/308] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:21 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:21.224068 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 154/309] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:21 2022] GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:22.042746 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-75429e71-ec0b-49b4-b06c-fccf9d69f7b9 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:22.043341 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-75429e71-ec0b-49b4-b06c-fccf9d69f7b9 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:22.049187 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-75429e71-ec0b-49b4-b06c-fccf9d69f7b9 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:22.049629 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-75429e71-ec0b-49b4-b06c-fccf9d69f7b9 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:22.050390 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-75429e71-ec0b-49b4-b06c-fccf9d69f7b9 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:22.050817 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-75429e71-ec0b-49b4-b06c-fccf9d69f7b9 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:22.181730 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-75429e71-ec0b-49b4-b06c-fccf9d69f7b9 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:22.188928 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-75429e71-ec0b-49b4-b06c-fccf9d69f7b9 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1318 microversion: 2.1 time: 0.149902 Feb 08 16:43:22.189490 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 156/310] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:22 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:22.240306 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e17e3783-84bd-4db1-bc17-5a6954ba52b1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:22.240856 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-628c41cf-60a0-4342-9cfa-f983e1b49116 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:22.240957 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e17e3783-84bd-4db1-bc17-5a6954ba52b1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:22.241044 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-628c41cf-60a0-4342-9cfa-f983e1b49116 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:22.247476 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-628c41cf-60a0-4342-9cfa-f983e1b49116 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:22.247747 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e17e3783-84bd-4db1-bc17-5a6954ba52b1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:22.247963 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-628c41cf-60a0-4342-9cfa-f983e1b49116 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:22.248137 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e17e3783-84bd-4db1-bc17-5a6954ba52b1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:22.248744 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-628c41cf-60a0-4342-9cfa-f983e1b49116 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:22.248914 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e17e3783-84bd-4db1-bc17-5a6954ba52b1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:22.249188 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-628c41cf-60a0-4342-9cfa-f983e1b49116 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:22.249349 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e17e3783-84bd-4db1-bc17-5a6954ba52b1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:22.395088 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e17e3783-84bd-4db1-bc17-5a6954ba52b1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f340df87346cea3eb5a091d93d3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82109ab07882467bb75fe01c154fbbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:22.398695 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-628c41cf-60a0-4342-9cfa-f983e1b49116 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:22.402891 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e17e3783-84bd-4db1-bc17-5a6954ba52b1 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] 10.222.0.35 "GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21" status: 200 len: 1314 microversion: 2.1 time: 0.166207 Feb 08 16:43:22.403459 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 155/311] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:22 2022] GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:22.406583 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-628c41cf-60a0-4342-9cfa-f983e1b49116 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.169672 Feb 08 16:43:22.407213 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 157/312] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:22 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:23.205747 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-5ce55ef6-42b0-467e-a7f3-7bd566fe2a20 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:23.206355 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-5ce55ef6-42b0-467e-a7f3-7bd566fe2a20 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:23.213433 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5ce55ef6-42b0-467e-a7f3-7bd566fe2a20 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:23.213887 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5ce55ef6-42b0-467e-a7f3-7bd566fe2a20 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:23.214673 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5ce55ef6-42b0-467e-a7f3-7bd566fe2a20 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:23.215133 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5ce55ef6-42b0-467e-a7f3-7bd566fe2a20 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:23.422536 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-4afe9b0b-4863-4565-a9f7-a9b7389adb68 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:23.423141 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-4afe9b0b-4863-4565-a9f7-a9b7389adb68 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:23.430751 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4afe9b0b-4863-4565-a9f7-a9b7389adb68 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:23.431316 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4afe9b0b-4863-4565-a9f7-a9b7389adb68 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:23.432569 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4afe9b0b-4863-4565-a9f7-a9b7389adb68 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:23.432793 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4afe9b0b-4863-4565-a9f7-a9b7389adb68 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:23.574744 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-4afe9b0b-4863-4565-a9f7-a9b7389adb68 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f340df87346cea3eb5a091d93d3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82109ab07882467bb75fe01c154fbbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:23.581917 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-4afe9b0b-4863-4565-a9f7-a9b7389adb68 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] 10.222.0.35 "GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21" status: 200 len: 1314 microversion: 2.1 time: 0.165729 Feb 08 16:43:23.582492 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 158/313] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:23 2022] GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:23.588062 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-2feb7224-9010-46bb-b4e2-f30fbe173685 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:23.588663 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-2feb7224-9010-46bb-b4e2-f30fbe173685 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:23.594476 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2feb7224-9010-46bb-b4e2-f30fbe173685 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:23.594928 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2feb7224-9010-46bb-b4e2-f30fbe173685 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:23.595703 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2feb7224-9010-46bb-b4e2-f30fbe173685 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:23.596158 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2feb7224-9010-46bb-b4e2-f30fbe173685 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:23.596708 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-5ce55ef6-42b0-467e-a7f3-7bd566fe2a20 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:23.604381 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-5ce55ef6-42b0-467e-a7f3-7bd566fe2a20 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1318 microversion: 2.1 time: 0.402027 Feb 08 16:43:23.605158 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 156/314] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:23 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:23.736437 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-2feb7224-9010-46bb-b4e2-f30fbe173685 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:23.744635 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-2feb7224-9010-46bb-b4e2-f30fbe173685 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.161021 Feb 08 16:43:23.745296 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 159/315] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:23 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:24.598019 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-753efa81-0f4b-42a4-895b-33a1ba9bde68 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:24.598559 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-753efa81-0f4b-42a4-895b-33a1ba9bde68 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:24.605574 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-753efa81-0f4b-42a4-895b-33a1ba9bde68 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:24.606017 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-753efa81-0f4b-42a4-895b-33a1ba9bde68 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:24.606786 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-753efa81-0f4b-42a4-895b-33a1ba9bde68 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:24.607215 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-753efa81-0f4b-42a4-895b-33a1ba9bde68 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:24.620741 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e610499d-a400-4394-aff8-43332d3aab11 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:24.621376 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e610499d-a400-4394-aff8-43332d3aab11 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:24.627081 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e610499d-a400-4394-aff8-43332d3aab11 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:24.627529 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e610499d-a400-4394-aff8-43332d3aab11 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:24.628336 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e610499d-a400-4394-aff8-43332d3aab11 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:24.628769 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e610499d-a400-4394-aff8-43332d3aab11 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:24.740125 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-753efa81-0f4b-42a4-895b-33a1ba9bde68 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f340df87346cea3eb5a091d93d3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82109ab07882467bb75fe01c154fbbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:24.747980 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-753efa81-0f4b-42a4-895b-33a1ba9bde68 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] 10.222.0.35 "GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21" status: 200 len: 1314 microversion: 2.1 time: 0.153532 Feb 08 16:43:24.748572 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 157/316] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:24 2022] GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:24.761183 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-4b856136-4e9c-4b64-bfa0-8f0a8dc8da05 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:24.761909 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4b856136-4e9c-4b64-bfa0-8f0a8dc8da05 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:24.767812 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4b856136-4e9c-4b64-bfa0-8f0a8dc8da05 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:24.769036 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4b856136-4e9c-4b64-bfa0-8f0a8dc8da05 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:24.769917 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4b856136-4e9c-4b64-bfa0-8f0a8dc8da05 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:24.770419 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4b856136-4e9c-4b64-bfa0-8f0a8dc8da05 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:24.770798 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e610499d-a400-4394-aff8-43332d3aab11 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:24.781024 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e610499d-a400-4394-aff8-43332d3aab11 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1318 microversion: 2.1 time: 0.163891 Feb 08 16:43:24.781598 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 160/317] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:24 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:24.904802 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4b856136-4e9c-4b64-bfa0-8f0a8dc8da05 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:24.912168 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-4b856136-4e9c-4b64-bfa0-8f0a8dc8da05 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.154414 Feb 08 16:43:24.921798 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 158/318] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:24 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:24.938007 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-f7b80e96-18b0-4b2d-b861-1a191fa9e490 req-7822c0a2-3c60-4e0e-b760-1095f6e66938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd2d934f-5925-4055-9b52-388a201fea21", "name": "network-vif-plugged", "status": "completed", "tag": "8fdd6258-0b21-4ea1-a254-24490bc5a5c6"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:43:24.939967 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:43:24.939967 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:43:24.946359 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-f7b80e96-18b0-4b2d-b861-1a191fa9e490 req-7822c0a2-3c60-4e0e-b760-1095f6e66938 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:24.946795 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-f7b80e96-18b0-4b2d-b861-1a191fa9e490 req-7822c0a2-3c60-4e0e-b760-1095f6e66938 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:24.958463 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-f7b80e96-18b0-4b2d-b861-1a191fa9e490 req-7822c0a2-3c60-4e0e-b760-1095f6e66938 service nova] Creating event network-vif-plugged:8fdd6258-0b21-4ea1-a254-24490bc5a5c6 for instance fd2d934f-5925-4055-9b52-388a201fea21 on hv-cinder-82786 Feb 08 16:43:24.963277 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-f7b80e96-18b0-4b2d-b861-1a191fa9e490 req-7822c0a2-3c60-4e0e-b760-1095f6e66938 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028834 Feb 08 16:43:24.964865 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 161/319] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:43:25.765014 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-73f07b95-4d8d-4f55-80fd-4c29f1514a81 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:25.765706 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-73f07b95-4d8d-4f55-80fd-4c29f1514a81 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:25.772039 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-73f07b95-4d8d-4f55-80fd-4c29f1514a81 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:25.772492 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-73f07b95-4d8d-4f55-80fd-4c29f1514a81 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:25.773275 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-73f07b95-4d8d-4f55-80fd-4c29f1514a81 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:25.773714 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-73f07b95-4d8d-4f55-80fd-4c29f1514a81 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:25.798496 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-aa2a4271-7dbb-4eb2-8510-51aaced3c1e7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:25.799348 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-aa2a4271-7dbb-4eb2-8510-51aaced3c1e7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:25.805417 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-aa2a4271-7dbb-4eb2-8510-51aaced3c1e7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:25.805936 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-aa2a4271-7dbb-4eb2-8510-51aaced3c1e7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:25.806790 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-aa2a4271-7dbb-4eb2-8510-51aaced3c1e7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:25.807343 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-aa2a4271-7dbb-4eb2-8510-51aaced3c1e7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:25.905622 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-73f07b95-4d8d-4f55-80fd-4c29f1514a81 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f340df87346cea3eb5a091d93d3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82109ab07882467bb75fe01c154fbbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:25.913724 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-73f07b95-4d8d-4f55-80fd-4c29f1514a81 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] 10.222.0.35 "GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21" status: 200 len: 1314 microversion: 2.1 time: 0.152535 Feb 08 16:43:25.914284 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 159/320] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:25 2022] GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:25.928753 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-511fa7dd-4690-4f6a-b732-5c254629dd9b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:25.929345 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-511fa7dd-4690-4f6a-b732-5c254629dd9b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:25.935227 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-511fa7dd-4690-4f6a-b732-5c254629dd9b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:25.935667 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-511fa7dd-4690-4f6a-b732-5c254629dd9b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:25.936468 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-511fa7dd-4690-4f6a-b732-5c254629dd9b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:25.936896 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-511fa7dd-4690-4f6a-b732-5c254629dd9b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:25.945655 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-aa2a4271-7dbb-4eb2-8510-51aaced3c1e7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:25.953024 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-aa2a4271-7dbb-4eb2-8510-51aaced3c1e7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1318 microversion: 2.1 time: 0.158500 Feb 08 16:43:25.953600 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 162/321] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:25 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:26.068239 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-511fa7dd-4690-4f6a-b732-5c254629dd9b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:26.075508 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-511fa7dd-4690-4f6a-b732-5c254629dd9b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.150234 Feb 08 16:43:26.076077 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 160/322] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:25 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:26.930151 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-8af991e3-0d8c-4943-b1c7-2eb3b41c6f0d tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:26.930670 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-8af991e3-0d8c-4943-b1c7-2eb3b41c6f0d tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:26.937381 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8af991e3-0d8c-4943-b1c7-2eb3b41c6f0d tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:26.937838 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8af991e3-0d8c-4943-b1c7-2eb3b41c6f0d tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:26.938621 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8af991e3-0d8c-4943-b1c7-2eb3b41c6f0d tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:26.939065 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8af991e3-0d8c-4943-b1c7-2eb3b41c6f0d tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:26.969224 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-95ebd325-ad8a-451e-9913-5e33e0a09e5d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:26.969823 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-95ebd325-ad8a-451e-9913-5e33e0a09e5d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:26.976100 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-95ebd325-ad8a-451e-9913-5e33e0a09e5d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:26.976542 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-95ebd325-ad8a-451e-9913-5e33e0a09e5d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:26.977313 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-95ebd325-ad8a-451e-9913-5e33e0a09e5d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:26.977743 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-95ebd325-ad8a-451e-9913-5e33e0a09e5d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:27.076693 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-8af991e3-0d8c-4943-b1c7-2eb3b41c6f0d tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f340df87346cea3eb5a091d93d3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82109ab07882467bb75fe01c154fbbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:27.083955 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-8af991e3-0d8c-4943-b1c7-2eb3b41c6f0d tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] 10.222.0.35 "GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21" status: 200 len: 1314 microversion: 2.1 time: 0.157486 Feb 08 16:43:27.084525 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 163/323] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:26 2022] GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:27.092111 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-550eb9b0-5156-41f0-af14-ce376fc067a5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:27.092719 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-550eb9b0-5156-41f0-af14-ce376fc067a5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:27.098430 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-550eb9b0-5156-41f0-af14-ce376fc067a5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:27.098890 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-550eb9b0-5156-41f0-af14-ce376fc067a5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:27.099674 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-550eb9b0-5156-41f0-af14-ce376fc067a5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:27.100153 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-550eb9b0-5156-41f0-af14-ce376fc067a5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:27.114706 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-95ebd325-ad8a-451e-9913-5e33e0a09e5d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:27.122457 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-95ebd325-ad8a-451e-9913-5e33e0a09e5d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1318 microversion: 2.1 time: 0.156786 Feb 08 16:43:27.123024 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 161/324] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:26 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:27.230776 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-550eb9b0-5156-41f0-af14-ce376fc067a5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:27.237994 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-550eb9b0-5156-41f0-af14-ce376fc067a5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.149885 Feb 08 16:43:27.238559 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 164/325] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:27 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:28.099901 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-3c4d91d0-5195-48a7-ae47-794caaeb6c9f tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:28.100453 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-3c4d91d0-5195-48a7-ae47-794caaeb6c9f tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:28.106784 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3c4d91d0-5195-48a7-ae47-794caaeb6c9f tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:28.107230 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3c4d91d0-5195-48a7-ae47-794caaeb6c9f tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:28.108026 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3c4d91d0-5195-48a7-ae47-794caaeb6c9f tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:28.108465 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3c4d91d0-5195-48a7-ae47-794caaeb6c9f tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:28.138729 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b949881a-3449-4ffc-b236-05234c645bd3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:28.139336 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b949881a-3449-4ffc-b236-05234c645bd3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:28.145171 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b949881a-3449-4ffc-b236-05234c645bd3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:28.145620 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b949881a-3449-4ffc-b236-05234c645bd3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:28.146398 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b949881a-3449-4ffc-b236-05234c645bd3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:28.146837 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b949881a-3449-4ffc-b236-05234c645bd3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:28.245224 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-3c4d91d0-5195-48a7-ae47-794caaeb6c9f tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f340df87346cea3eb5a091d93d3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82109ab07882467bb75fe01c154fbbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:28.254258 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-3c4d91d0-5195-48a7-ae47-794caaeb6c9f tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] 10.222.0.35 "GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21" status: 200 len: 1463 microversion: 2.1 time: 0.157954 Feb 08 16:43:28.254841 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 162/326] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:28 2022] GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21 => generated 1463 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:28.259285 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-0dc24651-60ee-4c88-b26c-b00218906422 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:28.260017 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-0dc24651-60ee-4c88-b26c-b00218906422 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:28.273951 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0dc24651-60ee-4c88-b26c-b00218906422 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:28.274398 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0dc24651-60ee-4c88-b26c-b00218906422 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:28.275195 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0dc24651-60ee-4c88-b26c-b00218906422 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:28.275857 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0dc24651-60ee-4c88-b26c-b00218906422 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:28.283611 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b949881a-3449-4ffc-b236-05234c645bd3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:28.291305 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b949881a-3449-4ffc-b236-05234c645bd3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1318 microversion: 2.1 time: 0.156861 Feb 08 16:43:28.292157 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 165/327] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:28 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:28.297511 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-53890fbc-1c18-4cf7-9346-fd0086ec318a tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:28.298076 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-53890fbc-1c18-4cf7-9346-fd0086ec318a tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:28.303775 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-53890fbc-1c18-4cf7-9346-fd0086ec318a tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:28.304226 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-53890fbc-1c18-4cf7-9346-fd0086ec318a tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:28.305029 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-53890fbc-1c18-4cf7-9346-fd0086ec318a tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:28.305463 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-53890fbc-1c18-4cf7-9346-fd0086ec318a tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:28.331046 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-53890fbc-1c18-4cf7-9346-fd0086ec318a tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] Going to try to terminate instance {{(pid=122902) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 16:43:28.414667 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-53890fbc-1c18-4cf7-9346-fd0086ec318a tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] 10.222.0.35 "DELETE /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21" status: 204 len: 0 microversion: 2.1 time: 0.121152 Feb 08 16:43:28.415940 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 166/328] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Feb 8 16:43:28 2022] DELETE /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 16:43:28.423653 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0dc24651-60ee-4c88-b26c-b00218906422 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:28.425088 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-1ebe12cc-1d78-47c9-ad8e-01e7b9786c9f tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:28.425779 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-1ebe12cc-1d78-47c9-ad8e-01e7b9786c9f tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:28.431513 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-0dc24651-60ee-4c88-b26c-b00218906422 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.175476 Feb 08 16:43:28.431677 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1ebe12cc-1d78-47c9-ad8e-01e7b9786c9f tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:28.432064 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1ebe12cc-1d78-47c9-ad8e-01e7b9786c9f tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:28.432288 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 163/329] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:28 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:28.433239 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1ebe12cc-1d78-47c9-ad8e-01e7b9786c9f tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:28.433684 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1ebe12cc-1d78-47c9-ad8e-01e7b9786c9f tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:28.568509 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-1ebe12cc-1d78-47c9-ad8e-01e7b9786c9f tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f340df87346cea3eb5a091d93d3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82109ab07882467bb75fe01c154fbbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:28.576566 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-1ebe12cc-1d78-47c9-ad8e-01e7b9786c9f tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] 10.222.0.35 "GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21" status: 200 len: 1469 microversion: 2.1 time: 0.155573 Feb 08 16:43:28.577151 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 167/330] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:28 2022] GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21 => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:29.307944 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-c539d286-da12-4753-9636-8959409f7251 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:29.308779 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-c539d286-da12-4753-9636-8959409f7251 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:29.315088 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c539d286-da12-4753-9636-8959409f7251 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:29.315534 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c539d286-da12-4753-9636-8959409f7251 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:29.316341 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c539d286-da12-4753-9636-8959409f7251 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:29.316776 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c539d286-da12-4753-9636-8959409f7251 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:29.445933 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c539d286-da12-4753-9636-8959409f7251 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:29.448476 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-12f979c2-741c-4cc9-8cdb-4823deb20182 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:29.449108 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-12f979c2-741c-4cc9-8cdb-4823deb20182 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:29.453190 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-c539d286-da12-4753-9636-8959409f7251 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1318 microversion: 2.1 time: 0.149612 Feb 08 16:43:29.454072 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 164/331] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:29 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:29.455032 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-12f979c2-741c-4cc9-8cdb-4823deb20182 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:29.455491 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-12f979c2-741c-4cc9-8cdb-4823deb20182 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:29.456512 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-12f979c2-741c-4cc9-8cdb-4823deb20182 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:29.456933 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-12f979c2-741c-4cc9-8cdb-4823deb20182 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:29.588962 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-12f979c2-741c-4cc9-8cdb-4823deb20182 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:29.593855 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-99439fdb-2450-474b-8b3f-2cc5d985d2f5 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:29.594466 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-99439fdb-2450-474b-8b3f-2cc5d985d2f5 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:29.596314 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-12f979c2-741c-4cc9-8cdb-4823deb20182 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.151429 Feb 08 16:43:29.597070 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 168/332] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:29 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:29.600319 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-99439fdb-2450-474b-8b3f-2cc5d985d2f5 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:29.600775 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-99439fdb-2450-474b-8b3f-2cc5d985d2f5 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:29.601628 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-99439fdb-2450-474b-8b3f-2cc5d985d2f5 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:29.602066 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-99439fdb-2450-474b-8b3f-2cc5d985d2f5 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:29.739471 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-99439fdb-2450-474b-8b3f-2cc5d985d2f5 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f340df87346cea3eb5a091d93d3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82109ab07882467bb75fe01c154fbbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:29.746984 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-99439fdb-2450-474b-8b3f-2cc5d985d2f5 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] 10.222.0.35 "GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21" status: 200 len: 1469 microversion: 2.1 time: 0.156687 Feb 08 16:43:29.747733 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 165/333] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:29 2022] GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21 => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:30.470186 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-12035eb1-ec28-43e6-93cf-c750358b0c37 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:30.470650 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-12035eb1-ec28-43e6-93cf-c750358b0c37 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:30.476406 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-12035eb1-ec28-43e6-93cf-c750358b0c37 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:30.476857 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-12035eb1-ec28-43e6-93cf-c750358b0c37 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:30.477627 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-12035eb1-ec28-43e6-93cf-c750358b0c37 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:30.478061 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-12035eb1-ec28-43e6-93cf-c750358b0c37 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:30.614004 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-11052049-5575-4ed7-a04c-27ae625e9d39 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:30.614696 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-11052049-5575-4ed7-a04c-27ae625e9d39 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:30.619054 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-12035eb1-ec28-43e6-93cf-c750358b0c37 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:30.621899 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-11052049-5575-4ed7-a04c-27ae625e9d39 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:30.622727 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-11052049-5575-4ed7-a04c-27ae625e9d39 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:30.623798 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-11052049-5575-4ed7-a04c-27ae625e9d39 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:30.624352 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-11052049-5575-4ed7-a04c-27ae625e9d39 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:30.628469 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-12035eb1-ec28-43e6-93cf-c750358b0c37 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1318 microversion: 2.1 time: 0.161981 Feb 08 16:43:30.629288 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 169/334] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:30 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:30.764188 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-23cb683c-be54-4e17-937a-c32c012257d0 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:30.764949 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-23cb683c-be54-4e17-937a-c32c012257d0 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:30.770850 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-23cb683c-be54-4e17-937a-c32c012257d0 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:30.771441 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-23cb683c-be54-4e17-937a-c32c012257d0 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:30.772260 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-23cb683c-be54-4e17-937a-c32c012257d0 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:30.772701 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-23cb683c-be54-4e17-937a-c32c012257d0 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:30.932012 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-23cb683c-be54-4e17-937a-c32c012257d0 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd82f340df87346cea3eb5a091d93d3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82109ab07882467bb75fe01c154fbbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:30.945111 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-23cb683c-be54-4e17-937a-c32c012257d0 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] 10.222.0.35 "GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21" status: 200 len: 1469 microversion: 2.1 time: 0.184511 Feb 08 16:43:30.947066 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-11052049-5575-4ed7-a04c-27ae625e9d39 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:30.954784 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-11052049-5575-4ed7-a04c-27ae625e9d39 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.344451 Feb 08 16:43:30.957746 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 166/335] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:30 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:30.967726 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 170/336] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:30 2022] GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21 => generated 1469 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:31.041123 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-8be89239-f52d-42a9-945c-8afd78cd3238 req-785ad66c-4532-4102-b599-74240bc59c1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd2d934f-5925-4055-9b52-388a201fea21", "name": "network-vif-deleted", "tag": "8fdd6258-0b21-4ea1-a254-24490bc5a5c6"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:43:31.044672 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:43:31.044672 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:43:31.053792 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-8be89239-f52d-42a9-945c-8afd78cd3238 req-785ad66c-4532-4102-b599-74240bc59c1f service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:31.054249 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-8be89239-f52d-42a9-945c-8afd78cd3238 req-785ad66c-4532-4102-b599-74240bc59c1f service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:31.067025 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-8be89239-f52d-42a9-945c-8afd78cd3238 req-785ad66c-4532-4102-b599-74240bc59c1f service nova] Creating event network-vif-deleted:8fdd6258-0b21-4ea1-a254-24490bc5a5c6 for instance fd2d934f-5925-4055-9b52-388a201fea21 on hv-cinder-82786 Feb 08 16:43:31.073335 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-8be89239-f52d-42a9-945c-8afd78cd3238 req-785ad66c-4532-4102-b599-74240bc59c1f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037080 Feb 08 16:43:31.073967 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 167/337] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:43:31.646163 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-94b46333-cc0a-4cf1-a474-3b0575ea7c1b tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:31.646776 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-94b46333-cc0a-4cf1-a474-3b0575ea7c1b tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:31.653483 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-94b46333-cc0a-4cf1-a474-3b0575ea7c1b tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:31.653937 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-94b46333-cc0a-4cf1-a474-3b0575ea7c1b tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:31.654719 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-94b46333-cc0a-4cf1-a474-3b0575ea7c1b tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:31.655156 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-94b46333-cc0a-4cf1-a474-3b0575ea7c1b tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:31.791051 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-94b46333-cc0a-4cf1-a474-3b0575ea7c1b tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:31.798729 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-94b46333-cc0a-4cf1-a474-3b0575ea7c1b tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1318 microversion: 2.1 time: 0.156221 Feb 08 16:43:31.799288 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 171/338] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:31 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:31.963421 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e763ba10-5f06-437d-88b5-2c3549e9ea20 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:31.964158 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e763ba10-5f06-437d-88b5-2c3549e9ea20 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] [instance: fd2d934f-5925-4055-9b52-388a201fea21] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:31.970408 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e763ba10-5f06-437d-88b5-2c3549e9ea20 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:31.970852 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e763ba10-5f06-437d-88b5-2c3549e9ea20 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:31.971621 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e763ba10-5f06-437d-88b5-2c3549e9ea20 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:31.972076 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e763ba10-5f06-437d-88b5-2c3549e9ea20 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:31.972710 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-408ad1dd-ca39-495d-a352-88fa1b8a45c3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:31.973323 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-408ad1dd-ca39-495d-a352-88fa1b8a45c3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:31.979232 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-408ad1dd-ca39-495d-a352-88fa1b8a45c3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:31.979790 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-408ad1dd-ca39-495d-a352-88fa1b8a45c3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:31.980582 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-408ad1dd-ca39-495d-a352-88fa1b8a45c3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:31.981024 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-408ad1dd-ca39-495d-a352-88fa1b8a45c3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:31.984822 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.wsgi [None req-e763ba10-5f06-437d-88b5-2c3549e9ea20 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] HTTP exception thrown: Instance fd2d934f-5925-4055-9b52-388a201fea21 could not be found. Feb 08 16:43:31.985408 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e763ba10-5f06-437d-88b5-2c3549e9ea20 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] Returning 404 to user: Instance fd2d934f-5925-4055-9b52-388a201fea21 could not be found. {{(pid=122901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:43:31.986268 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e763ba10-5f06-437d-88b5-2c3549e9ea20 tempest-VolumesNegativeTest-1506038298 tempest-VolumesNegativeTest-1506038298-project] 10.222.0.35 "GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21" status: 404 len: 111 microversion: 2.1 time: 0.027257 Feb 08 16:43:31.986757 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 168/339] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:31 2022] GET /compute/v2.1/servers/fd2d934f-5925-4055-9b52-388a201fea21 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:43:32.118211 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-408ad1dd-ca39-495d-a352-88fa1b8a45c3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:32.126503 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-408ad1dd-ca39-495d-a352-88fa1b8a45c3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.157391 Feb 08 16:43:32.127070 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 172/340] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:31 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:32.816815 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ed2115ff-33a9-437d-b031-1354c95d4f17 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:32.817330 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-ed2115ff-33a9-437d-b031-1354c95d4f17 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:32.823614 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ed2115ff-33a9-437d-b031-1354c95d4f17 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:32.824224 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ed2115ff-33a9-437d-b031-1354c95d4f17 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:32.825018 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ed2115ff-33a9-437d-b031-1354c95d4f17 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:32.825458 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ed2115ff-33a9-437d-b031-1354c95d4f17 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:32.977287 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ed2115ff-33a9-437d-b031-1354c95d4f17 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:32.985232 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-ed2115ff-33a9-437d-b031-1354c95d4f17 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1318 microversion: 2.1 time: 0.173401 Feb 08 16:43:32.986005 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 169/341] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:32 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:33.049808 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-c55d4d21-714b-454d-a35b-e2b4c92c89f0 req-4c152edd-0a6b-4357-a2b4-d35fe6a56652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "547dd9a2-9f3b-49f5-a2f7-34e5283b9aed", "name": "network-vif-plugged", "status": "completed", "tag": "6d242b95-699b-413d-9b89-1b82e91da648"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:43:33.051374 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:43:33.051374 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:43:33.058923 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-c55d4d21-714b-454d-a35b-e2b4c92c89f0 req-4c152edd-0a6b-4357-a2b4-d35fe6a56652 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:33.059188 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-c55d4d21-714b-454d-a35b-e2b4c92c89f0 req-4c152edd-0a6b-4357-a2b4-d35fe6a56652 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:33.078298 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-c55d4d21-714b-454d-a35b-e2b4c92c89f0 req-4c152edd-0a6b-4357-a2b4-d35fe6a56652 service nova] Creating event network-vif-plugged:6d242b95-699b-413d-9b89-1b82e91da648 for instance 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed on hv-cinder-82786 Feb 08 16:43:33.083217 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-c55d4d21-714b-454d-a35b-e2b4c92c89f0 req-4c152edd-0a6b-4357-a2b4-d35fe6a56652 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037137 Feb 08 16:43:33.083989 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 173/342] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:43:33.144508 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-16c11080-b891-42e4-be6e-90c1f19eeaee tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:33.145274 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-16c11080-b891-42e4-be6e-90c1f19eeaee tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:33.153073 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-16c11080-b891-42e4-be6e-90c1f19eeaee tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:33.153528 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-16c11080-b891-42e4-be6e-90c1f19eeaee tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:33.154380 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-16c11080-b891-42e4-be6e-90c1f19eeaee tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:33.154821 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-16c11080-b891-42e4-be6e-90c1f19eeaee tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:33.297876 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-16c11080-b891-42e4-be6e-90c1f19eeaee tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:33.305194 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-16c11080-b891-42e4-be6e-90c1f19eeaee tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.164896 Feb 08 16:43:33.305850 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 170/343] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:33 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:34.001950 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-9cf2ebee-df5e-4f98-8072-20a51f09fdf0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:34.002656 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-9cf2ebee-df5e-4f98-8072-20a51f09fdf0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:34.009197 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9cf2ebee-df5e-4f98-8072-20a51f09fdf0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:34.009719 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9cf2ebee-df5e-4f98-8072-20a51f09fdf0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:34.011059 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9cf2ebee-df5e-4f98-8072-20a51f09fdf0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:34.011608 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9cf2ebee-df5e-4f98-8072-20a51f09fdf0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:34.169930 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9cf2ebee-df5e-4f98-8072-20a51f09fdf0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:34.177935 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-9cf2ebee-df5e-4f98-8072-20a51f09fdf0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1318 microversion: 2.1 time: 0.179828 Feb 08 16:43:34.178608 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 174/344] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:33 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:34.321972 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-6618be91-85fe-475b-92e8-c04192d2367a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:34.323330 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-6618be91-85fe-475b-92e8-c04192d2367a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:34.329579 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6618be91-85fe-475b-92e8-c04192d2367a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:34.330029 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6618be91-85fe-475b-92e8-c04192d2367a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:34.330816 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6618be91-85fe-475b-92e8-c04192d2367a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:34.331261 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6618be91-85fe-475b-92e8-c04192d2367a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:34.469147 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-6618be91-85fe-475b-92e8-c04192d2367a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:34.477197 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-6618be91-85fe-475b-92e8-c04192d2367a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.158793 Feb 08 16:43:34.477778 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 171/345] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:34 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:35.194689 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-17e3fcde-08d3-485f-90de-b46e22b44c71 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:35.195225 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-17e3fcde-08d3-485f-90de-b46e22b44c71 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:35.201751 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-17e3fcde-08d3-485f-90de-b46e22b44c71 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:35.202201 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-17e3fcde-08d3-485f-90de-b46e22b44c71 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:35.202976 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-17e3fcde-08d3-485f-90de-b46e22b44c71 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:35.203413 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-17e3fcde-08d3-485f-90de-b46e22b44c71 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:35.338998 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-17e3fcde-08d3-485f-90de-b46e22b44c71 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:35.346181 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-17e3fcde-08d3-485f-90de-b46e22b44c71 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1318 microversion: 2.1 time: 0.155162 Feb 08 16:43:35.346737 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 175/346] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:35 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:35.494199 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-24b80db7-c0e3-4c6e-8bb5-ea0632006ddb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:35.494975 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-24b80db7-c0e3-4c6e-8bb5-ea0632006ddb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:35.501221 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-24b80db7-c0e3-4c6e-8bb5-ea0632006ddb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:35.501669 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-24b80db7-c0e3-4c6e-8bb5-ea0632006ddb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:35.502446 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-24b80db7-c0e3-4c6e-8bb5-ea0632006ddb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:35.502876 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-24b80db7-c0e3-4c6e-8bb5-ea0632006ddb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:35.637032 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-24b80db7-c0e3-4c6e-8bb5-ea0632006ddb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:35.645045 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-24b80db7-c0e3-4c6e-8bb5-ea0632006ddb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.154487 Feb 08 16:43:35.645615 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 172/347] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:35 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:36.361977 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-5634f4d7-3024-428b-bb66-1f4a861f8922 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:36.362588 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-5634f4d7-3024-428b-bb66-1f4a861f8922 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:36.368579 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5634f4d7-3024-428b-bb66-1f4a861f8922 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:36.369025 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5634f4d7-3024-428b-bb66-1f4a861f8922 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:36.369977 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5634f4d7-3024-428b-bb66-1f4a861f8922 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:36.370413 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5634f4d7-3024-428b-bb66-1f4a861f8922 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:36.500490 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-5634f4d7-3024-428b-bb66-1f4a861f8922 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:36.507826 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-5634f4d7-3024-428b-bb66-1f4a861f8922 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1318 microversion: 2.1 time: 0.149432 Feb 08 16:43:36.508381 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 176/348] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:36 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:36.661303 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-a3be81ae-984b-43f5-8542-47165aee7339 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:36.661843 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-a3be81ae-984b-43f5-8542-47165aee7339 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:36.668781 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a3be81ae-984b-43f5-8542-47165aee7339 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:36.669271 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a3be81ae-984b-43f5-8542-47165aee7339 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:36.669990 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a3be81ae-984b-43f5-8542-47165aee7339 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:36.670420 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a3be81ae-984b-43f5-8542-47165aee7339 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:36.801071 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-a3be81ae-984b-43f5-8542-47165aee7339 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:36.808839 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-a3be81ae-984b-43f5-8542-47165aee7339 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.151316 Feb 08 16:43:36.809413 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 173/349] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:36 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:37.524281 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-f3998c7d-734a-436f-8cdd-c2870dba28c0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:37.524894 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-f3998c7d-734a-436f-8cdd-c2870dba28c0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:37.530842 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f3998c7d-734a-436f-8cdd-c2870dba28c0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:37.531290 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f3998c7d-734a-436f-8cdd-c2870dba28c0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:37.532158 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f3998c7d-734a-436f-8cdd-c2870dba28c0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:37.532593 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f3998c7d-734a-436f-8cdd-c2870dba28c0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:37.668020 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-f3998c7d-734a-436f-8cdd-c2870dba28c0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:37.678980 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-f3998c7d-734a-436f-8cdd-c2870dba28c0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1318 microversion: 2.1 time: 0.158292 Feb 08 16:43:37.679548 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 177/350] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:37 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:37.825184 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-4586f6f9-4398-4b2d-8ba1-77e1d53bc197 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:37.825793 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4586f6f9-4398-4b2d-8ba1-77e1d53bc197 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:37.832073 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4586f6f9-4398-4b2d-8ba1-77e1d53bc197 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:37.832525 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4586f6f9-4398-4b2d-8ba1-77e1d53bc197 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:37.833300 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4586f6f9-4398-4b2d-8ba1-77e1d53bc197 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:37.833742 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4586f6f9-4398-4b2d-8ba1-77e1d53bc197 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:37.970228 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4586f6f9-4398-4b2d-8ba1-77e1d53bc197 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:37.977396 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-4586f6f9-4398-4b2d-8ba1-77e1d53bc197 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.155897 Feb 08 16:43:37.977954 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 174/351] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:37 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:38.699016 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-81927db0-ae56-40dc-aae5-4b807439bb0c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:38.699607 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-81927db0-ae56-40dc-aae5-4b807439bb0c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:38.707444 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-81927db0-ae56-40dc-aae5-4b807439bb0c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:38.707917 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-81927db0-ae56-40dc-aae5-4b807439bb0c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:38.708692 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-81927db0-ae56-40dc-aae5-4b807439bb0c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:38.709120 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-81927db0-ae56-40dc-aae5-4b807439bb0c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:38.844161 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-81927db0-ae56-40dc-aae5-4b807439bb0c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:38.851340 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-81927db0-ae56-40dc-aae5-4b807439bb0c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1318 microversion: 2.1 time: 0.158873 Feb 08 16:43:38.851982 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 178/352] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:38 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:38.996508 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-105eac3f-6acb-4953-a15a-2a9677f9acd1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:38.998469 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-105eac3f-6acb-4953-a15a-2a9677f9acd1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:39.006572 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-105eac3f-6acb-4953-a15a-2a9677f9acd1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:39.007060 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-105eac3f-6acb-4953-a15a-2a9677f9acd1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:39.015455 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-105eac3f-6acb-4953-a15a-2a9677f9acd1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:39.015455 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-105eac3f-6acb-4953-a15a-2a9677f9acd1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:39.162104 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-105eac3f-6acb-4953-a15a-2a9677f9acd1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:39.170477 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-105eac3f-6acb-4953-a15a-2a9677f9acd1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.179130 Feb 08 16:43:39.171474 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 175/353] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:38 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:39.868862 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-7c57756b-aaf1-45dd-ac35-bcacec829ff8 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:39.870124 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-7c57756b-aaf1-45dd-ac35-bcacec829ff8 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:39.875962 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7c57756b-aaf1-45dd-ac35-bcacec829ff8 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:39.876414 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7c57756b-aaf1-45dd-ac35-bcacec829ff8 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:39.877187 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7c57756b-aaf1-45dd-ac35-bcacec829ff8 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:39.877622 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7c57756b-aaf1-45dd-ac35-bcacec829ff8 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:40.008934 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-7c57756b-aaf1-45dd-ac35-bcacec829ff8 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:40.016291 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-7c57756b-aaf1-45dd-ac35-bcacec829ff8 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1318 microversion: 2.1 time: 0.151261 Feb 08 16:43:40.016855 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 179/354] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:39 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:40.194211 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-4fd1bbf2-3a92-4253-a6f1-51e5a623a5d6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:40.194820 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4fd1bbf2-3a92-4253-a6f1-51e5a623a5d6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:40.201281 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4fd1bbf2-3a92-4253-a6f1-51e5a623a5d6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:40.201730 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4fd1bbf2-3a92-4253-a6f1-51e5a623a5d6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:40.202507 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4fd1bbf2-3a92-4253-a6f1-51e5a623a5d6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:40.202941 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4fd1bbf2-3a92-4253-a6f1-51e5a623a5d6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:40.346975 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4fd1bbf2-3a92-4253-a6f1-51e5a623a5d6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:40.355457 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-4fd1bbf2-3a92-4253-a6f1-51e5a623a5d6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.164863 Feb 08 16:43:40.356140 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 176/355] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:40 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:41.036721 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-734d6230-486d-4d4f-9d6d-fe4c9b8a5d01 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:41.038626 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-734d6230-486d-4d4f-9d6d-fe4c9b8a5d01 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:41.047497 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-734d6230-486d-4d4f-9d6d-fe4c9b8a5d01 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:41.048773 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-734d6230-486d-4d4f-9d6d-fe4c9b8a5d01 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:41.050208 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-734d6230-486d-4d4f-9d6d-fe4c9b8a5d01 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:41.050967 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-734d6230-486d-4d4f-9d6d-fe4c9b8a5d01 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:41.212718 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-734d6230-486d-4d4f-9d6d-fe4c9b8a5d01 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:41.221857 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-734d6230-486d-4d4f-9d6d-fe4c9b8a5d01 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1508 microversion: 2.1 time: 0.191844 Feb 08 16:43:41.223012 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 180/356] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:41 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1508 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:41.377754 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e00cfa85-251c-42de-8507-ea85a4996beb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:41.378389 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e00cfa85-251c-42de-8507-ea85a4996beb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:41.384899 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e00cfa85-251c-42de-8507-ea85a4996beb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:41.385647 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e00cfa85-251c-42de-8507-ea85a4996beb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:41.386607 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e00cfa85-251c-42de-8507-ea85a4996beb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:41.387207 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e00cfa85-251c-42de-8507-ea85a4996beb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:41.624741 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e00cfa85-251c-42de-8507-ea85a4996beb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:41.633414 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e00cfa85-251c-42de-8507-ea85a4996beb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.264173 Feb 08 16:43:41.640970 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 177/357] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:41 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:42.654785 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-2844dbe0-0c00-413b-b0cc-4c5c8b8da69f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:42.655988 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-2844dbe0-0c00-413b-b0cc-4c5c8b8da69f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:42.662875 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2844dbe0-0c00-413b-b0cc-4c5c8b8da69f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:42.663461 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2844dbe0-0c00-413b-b0cc-4c5c8b8da69f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:42.664494 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2844dbe0-0c00-413b-b0cc-4c5c8b8da69f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:42.665089 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2844dbe0-0c00-413b-b0cc-4c5c8b8da69f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:42.804172 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-2844dbe0-0c00-413b-b0cc-4c5c8b8da69f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:42.812317 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-2844dbe0-0c00-413b-b0cc-4c5c8b8da69f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1521 microversion: 2.1 time: 0.164246 Feb 08 16:43:42.812887 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 181/358] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:42 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:43.734255 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-33fadee4-ccee-4313-89db-f8feff510131 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9647ca6-0f49-4aa1-a05a-cd076800708d"}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:43:43.735615 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-33fadee4-ccee-4313-89db-f8feff510131 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:43.736985 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-8953fce8-ee34-4faf-953c-6a8a7b3ce7d5 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-315974786", "imageRef": "d70d3911-14f2-4cba-9283-bf4bef4fb526", "flavorRef": "452", "networks": [{"uuid": "8fa132bb-f81d-40c5-97f2-e1964294199e"}]}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:43:43.742718 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-33fadee4-ccee-4313-89db-f8feff510131 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:43.743286 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-33fadee4-ccee-4313-89db-f8feff510131 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:43.745101 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-33fadee4-ccee-4313-89db-f8feff510131 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:43.745641 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-33fadee4-ccee-4313-89db-f8feff510131 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:43.796251 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.network.neutron [None req-8953fce8-ee34-4faf-953c-6a8a7b3ce7d5 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] validate_networks() for [('8fa132bb-f81d-40c5-97f2-e1964294199e', None, None, None, None, None)] {{(pid=122902) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 16:43:44.001840 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-33fadee4-ccee-4313-89db-f8feff510131 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "POST /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271549 Feb 08 16:43:44.002797 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 178/359] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Feb 8 16:43:43 2022] POST /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:43:44.008647 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e088d2b9-47fa-4b01-98d5-4d791d12a3b3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:44.009623 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e088d2b9-47fa-4b01-98d5-4d791d12a3b3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:44.017265 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e088d2b9-47fa-4b01-98d5-4d791d12a3b3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:44.017997 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e088d2b9-47fa-4b01-98d5-4d791d12a3b3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:44.019040 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e088d2b9-47fa-4b01-98d5-4d791d12a3b3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:44.019893 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e088d2b9-47fa-4b01-98d5-4d791d12a3b3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:44.185855 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e088d2b9-47fa-4b01-98d5-4d791d12a3b3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:44.193717 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e088d2b9-47fa-4b01-98d5-4d791d12a3b3 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1501 microversion: 2.1 time: 0.189312 Feb 08 16:43:44.194418 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 179/360] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:44 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1501 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:44.210302 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-166e1337-8584-4197-bd2c-92638a8fed32 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:44.211637 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-166e1337-8584-4197-bd2c-92638a8fed32 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:44.218993 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-166e1337-8584-4197-bd2c-92638a8fed32 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:44.219736 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-166e1337-8584-4197-bd2c-92638a8fed32 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:44.220562 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-166e1337-8584-4197-bd2c-92638a8fed32 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:44.220990 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-166e1337-8584-4197-bd2c-92638a8fed32 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:44.349038 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-8953fce8-ee34-4faf-953c-6a8a7b3ce7d5 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Flavor limits 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 16:43:44.349601 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-8953fce8-ee34-4faf-953c-6a8a7b3ce7d5 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Image limits 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 16:43:44.350080 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-8953fce8-ee34-4faf-953c-6a8a7b3ce7d5 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Flavor pref 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 16:43:44.350490 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-8953fce8-ee34-4faf-953c-6a8a7b3ce7d5 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Image pref 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 16:43:44.351088 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-8953fce8-ee34-4faf-953c-6a8a7b3ce7d5 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 16:43:44.366460 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8953fce8-ee34-4faf-953c-6a8a7b3ce7d5 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:44.366910 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8953fce8-ee34-4faf-953c-6a8a7b3ce7d5 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:44.367729 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8953fce8-ee34-4faf-953c-6a8a7b3ce7d5 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:44.368189 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8953fce8-ee34-4faf-953c-6a8a7b3ce7d5 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:44.396845 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-8953fce8-ee34-4faf-953c-6a8a7b3ce7d5 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Getting quotas for project 55220445da0d49ac8713e9036e8e6e06. Resources: {'cores', 'ram', 'instances'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:43:44.401429 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-8953fce8-ee34-4faf-953c-6a8a7b3ce7d5 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Getting quotas for user 2a7421e6184e497eb23bf9f87957322c and project 55220445da0d49ac8713e9036e8e6e06. Resources: {'cores', 'ram', 'instances'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:43:44.413542 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-8953fce8-ee34-4faf-953c-6a8a7b3ce7d5 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Going to run 1 instances... {{(pid=122902) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 16:43:44.417193 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-8953fce8-ee34-4faf-953c-6a8a7b3ce7d5 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d70d3911-14f2-4cba-9283-bf4bef4fb526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 16:43:44.472409 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-8953fce8-ee34-4faf-953c-6a8a7b3ce7d5 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738281 Feb 08 16:43:44.473113 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 182/361] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Feb 8 16:43:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 08 16:43:44.489887 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e6cf9122-cab6-4791-9583-aa4b0aba71e7 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:44.490679 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e6cf9122-cab6-4791-9583-aa4b0aba71e7 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:44.518905 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-166e1337-8584-4197-bd2c-92638a8fed32 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:44.533841 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-166e1337-8584-4197-bd2c-92638a8fed32 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1514 microversion: 2.1 time: 0.327371 Feb 08 16:43:44.542920 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 180/362] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:44 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1514 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:44.581723 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e6cf9122-cab6-4791-9583-aa4b0aba71e7 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:44.591557 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e6cf9122-cab6-4791-9583-aa4b0aba71e7 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1218 microversion: 2.1 time: 0.107573 Feb 08 16:43:44.592472 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 183/363] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:44 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:45.609067 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-683e3f52-5f13-4ab8-9587-eec938b98082 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:45.609872 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-683e3f52-5f13-4ab8-9587-eec938b98082 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:45.615927 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-683e3f52-5f13-4ab8-9587-eec938b98082 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:45.620238 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-683e3f52-5f13-4ab8-9587-eec938b98082 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:45.621288 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-683e3f52-5f13-4ab8-9587-eec938b98082 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:45.622892 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-683e3f52-5f13-4ab8-9587-eec938b98082 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:45.709413 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-683e3f52-5f13-4ab8-9587-eec938b98082 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:45.719600 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-683e3f52-5f13-4ab8-9587-eec938b98082 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1270 microversion: 2.1 time: 0.114877 Feb 08 16:43:45.721017 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 181/364] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:45 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1270 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:46.078117 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-528badea-9382-4228-9c44-50e4171cdb01 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:43:46.079876 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-528badea-9382-4228-9c44-50e4171cdb01 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:46.090023 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-528badea-9382-4228-9c44-50e4171cdb01 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:46.090478 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-528badea-9382-4228-9c44-50e4171cdb01 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:46.091324 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-528badea-9382-4228-9c44-50e4171cdb01 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:46.094077 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-528badea-9382-4228-9c44-50e4171cdb01 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:46.124223 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.objects.instance [None req-528badea-9382-4228-9c44-50e4171cdb01 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lazy-loading 'flavor' on Instance uuid 46b82748-ebae-4771-b414-3feb285df38d {{(pid=122902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:43:46.291577 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-528badea-9382-4228-9c44-50e4171cdb01 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "POST /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d/action" status: 200 len: 32 microversion: 2.1 time: 0.217377 Feb 08 16:43:46.292554 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 184/365] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Feb 8 16:43:46 2022] POST /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d/action => generated 32 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 08 16:43:46.300836 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-1278aa19-ed25-4d46-b140-a24763fe896d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:46.301542 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-1278aa19-ed25-4d46-b140-a24763fe896d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:46.316860 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1278aa19-ed25-4d46-b140-a24763fe896d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:46.317323 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1278aa19-ed25-4d46-b140-a24763fe896d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:46.318113 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1278aa19-ed25-4d46-b140-a24763fe896d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:46.318553 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1278aa19-ed25-4d46-b140-a24763fe896d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:46.621442 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-1278aa19-ed25-4d46-b140-a24763fe896d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:46.633656 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-1278aa19-ed25-4d46-b140-a24763fe896d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.336364 Feb 08 16:43:46.641045 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 182/366] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:46 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:46.739489 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c4d44d2c-c090-42fe-9e9a-60b65b990871 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:46.740224 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c4d44d2c-c090-42fe-9e9a-60b65b990871 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:46.750489 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c4d44d2c-c090-42fe-9e9a-60b65b990871 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:46.750941 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c4d44d2c-c090-42fe-9e9a-60b65b990871 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:46.751733 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c4d44d2c-c090-42fe-9e9a-60b65b990871 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:46.752192 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c4d44d2c-c090-42fe-9e9a-60b65b990871 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:47.111572 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c4d44d2c-c090-42fe-9e9a-60b65b990871 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:47.122794 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c4d44d2c-c090-42fe-9e9a-60b65b990871 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1318 microversion: 2.1 time: 0.387495 Feb 08 16:43:47.133065 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 185/367] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:46 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:47.578899 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-1528e813-d0c7-451c-b063-0f4975e04c98 req-5bf79743-67f1-42e8-8384-7e10039ca821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b66ad307-27dc-4150-b8c8-fe488dca0906", "tag": "7b51cb9a-da70-41bd-8fd9-16b61091a7c2"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:43:47.583839 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:43:47.583839 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:43:47.593049 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-1528e813-d0c7-451c-b063-0f4975e04c98 req-5bf79743-67f1-42e8-8384-7e10039ca821 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:47.593819 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-1528e813-d0c7-451c-b063-0f4975e04c98 req-5bf79743-67f1-42e8-8384-7e10039ca821 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:47.608087 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-1528e813-d0c7-451c-b063-0f4975e04c98 req-5bf79743-67f1-42e8-8384-7e10039ca821 service nova] Creating event network-changed:7b51cb9a-da70-41bd-8fd9-16b61091a7c2 for instance b66ad307-27dc-4150-b8c8-fe488dca0906 on hv-cinder-82786 Feb 08 16:43:47.620221 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-1528e813-d0c7-451c-b063-0f4975e04c98 req-5bf79743-67f1-42e8-8384-7e10039ca821 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045008 Feb 08 16:43:47.621386 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 183/368] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:43:47.652386 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-679433e0-8f4d-47dd-ada5-4b87a202e775 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:47.653037 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-679433e0-8f4d-47dd-ada5-4b87a202e775 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:47.661314 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-679433e0-8f4d-47dd-ada5-4b87a202e775 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:47.661819 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-679433e0-8f4d-47dd-ada5-4b87a202e775 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:47.662728 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-679433e0-8f4d-47dd-ada5-4b87a202e775 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:47.663170 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-679433e0-8f4d-47dd-ada5-4b87a202e775 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:47.847481 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-679433e0-8f4d-47dd-ada5-4b87a202e775 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:47.856830 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-679433e0-8f4d-47dd-ada5-4b87a202e775 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.208764 Feb 08 16:43:47.857609 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 186/369] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:47 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:48.140564 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-c9f4cdd3-169b-4fc8-bf40-61130de90025 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:48.142170 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-c9f4cdd3-169b-4fc8-bf40-61130de90025 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:48.149278 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c9f4cdd3-169b-4fc8-bf40-61130de90025 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:48.149847 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c9f4cdd3-169b-4fc8-bf40-61130de90025 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:48.150882 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c9f4cdd3-169b-4fc8-bf40-61130de90025 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:48.151482 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c9f4cdd3-169b-4fc8-bf40-61130de90025 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:48.446723 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c9f4cdd3-169b-4fc8-bf40-61130de90025 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:48.460415 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-c9f4cdd3-169b-4fc8-bf40-61130de90025 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1318 microversion: 2.1 time: 0.322119 Feb 08 16:43:48.464290 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 184/370] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:48 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:48.876452 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-db1e8d7d-a34c-4a6e-8408-371e79b23bc5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:48.879027 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-db1e8d7d-a34c-4a6e-8408-371e79b23bc5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:48.887941 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-db1e8d7d-a34c-4a6e-8408-371e79b23bc5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:48.889037 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-db1e8d7d-a34c-4a6e-8408-371e79b23bc5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:48.891304 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-db1e8d7d-a34c-4a6e-8408-371e79b23bc5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:48.891903 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-db1e8d7d-a34c-4a6e-8408-371e79b23bc5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:49.053915 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-db1e8d7d-a34c-4a6e-8408-371e79b23bc5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:49.062572 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-db1e8d7d-a34c-4a6e-8408-371e79b23bc5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.191366 Feb 08 16:43:49.063535 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 187/371] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:48 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:49.477504 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-78a5faf5-7674-4cc9-9445-3725eb11b6a1 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:49.478692 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-78a5faf5-7674-4cc9-9445-3725eb11b6a1 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:49.485099 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-78a5faf5-7674-4cc9-9445-3725eb11b6a1 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:49.485550 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-78a5faf5-7674-4cc9-9445-3725eb11b6a1 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:49.486355 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-78a5faf5-7674-4cc9-9445-3725eb11b6a1 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:49.486784 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-78a5faf5-7674-4cc9-9445-3725eb11b6a1 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:49.621667 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-78a5faf5-7674-4cc9-9445-3725eb11b6a1 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:49.629316 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-78a5faf5-7674-4cc9-9445-3725eb11b6a1 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1318 microversion: 2.1 time: 0.155471 Feb 08 16:43:49.630214 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 185/372] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:49 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:50.080048 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b582f06b-82ff-404d-bab7-3db5a9f038e0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:50.080659 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b582f06b-82ff-404d-bab7-3db5a9f038e0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:50.086488 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b582f06b-82ff-404d-bab7-3db5a9f038e0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:50.086935 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b582f06b-82ff-404d-bab7-3db5a9f038e0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:50.088543 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b582f06b-82ff-404d-bab7-3db5a9f038e0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:50.088995 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b582f06b-82ff-404d-bab7-3db5a9f038e0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:50.220217 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b582f06b-82ff-404d-bab7-3db5a9f038e0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:50.227481 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b582f06b-82ff-404d-bab7-3db5a9f038e0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.151018 Feb 08 16:43:50.228681 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 188/373] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:50 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:50.646089 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e0ce9362-5e81-4554-8602-a9ce8eb82623 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:50.647004 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e0ce9362-5e81-4554-8602-a9ce8eb82623 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:50.654124 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e0ce9362-5e81-4554-8602-a9ce8eb82623 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:50.654575 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e0ce9362-5e81-4554-8602-a9ce8eb82623 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:50.655390 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e0ce9362-5e81-4554-8602-a9ce8eb82623 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:50.655853 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e0ce9362-5e81-4554-8602-a9ce8eb82623 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:50.786006 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e0ce9362-5e81-4554-8602-a9ce8eb82623 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:50.793139 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e0ce9362-5e81-4554-8602-a9ce8eb82623 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1318 microversion: 2.1 time: 0.150604 Feb 08 16:43:50.793701 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 186/374] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:50 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:51.245283 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-674c9595-56a8-4671-815a-8a68fbb8a2a6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:51.245878 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-674c9595-56a8-4671-815a-8a68fbb8a2a6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:51.251745 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-674c9595-56a8-4671-815a-8a68fbb8a2a6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:51.252213 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-674c9595-56a8-4671-815a-8a68fbb8a2a6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:51.252975 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-674c9595-56a8-4671-815a-8a68fbb8a2a6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:51.253403 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-674c9595-56a8-4671-815a-8a68fbb8a2a6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:51.386700 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-674c9595-56a8-4671-815a-8a68fbb8a2a6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:51.394018 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-674c9595-56a8-4671-815a-8a68fbb8a2a6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.153114 Feb 08 16:43:51.394586 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 189/375] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:51 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:51.809677 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e6c9c40a-2611-440a-973a-2a92626a1ff0 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:51.810292 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e6c9c40a-2611-440a-973a-2a92626a1ff0 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:51.816566 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e6c9c40a-2611-440a-973a-2a92626a1ff0 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:51.817020 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e6c9c40a-2611-440a-973a-2a92626a1ff0 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:51.817800 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e6c9c40a-2611-440a-973a-2a92626a1ff0 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:51.818237 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e6c9c40a-2611-440a-973a-2a92626a1ff0 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:51.948238 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e6c9c40a-2611-440a-973a-2a92626a1ff0 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:51.955306 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e6c9c40a-2611-440a-973a-2a92626a1ff0 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1318 microversion: 2.1 time: 0.149320 Feb 08 16:43:51.955892 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 187/376] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:51 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:52.412333 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-9aa651d5-9824-4c76-83ce-b28cfc50b49b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:52.413046 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-9aa651d5-9824-4c76-83ce-b28cfc50b49b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:52.419652 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9aa651d5-9824-4c76-83ce-b28cfc50b49b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:52.420152 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9aa651d5-9824-4c76-83ce-b28cfc50b49b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:52.420936 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9aa651d5-9824-4c76-83ce-b28cfc50b49b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:52.421377 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9aa651d5-9824-4c76-83ce-b28cfc50b49b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:52.550584 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9aa651d5-9824-4c76-83ce-b28cfc50b49b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:52.558036 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-9aa651d5-9824-4c76-83ce-b28cfc50b49b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.149422 Feb 08 16:43:52.558723 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 190/377] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:52 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:52.972263 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b15d8199-c3aa-4875-826a-21b8190862ca tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:52.972788 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-b15d8199-c3aa-4875-826a-21b8190862ca tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:52.980791 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b15d8199-c3aa-4875-826a-21b8190862ca tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:52.981234 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b15d8199-c3aa-4875-826a-21b8190862ca tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:52.982026 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b15d8199-c3aa-4875-826a-21b8190862ca tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:52.982459 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b15d8199-c3aa-4875-826a-21b8190862ca tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:53.131906 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-b15d8199-c3aa-4875-826a-21b8190862ca tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:53.139373 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-b15d8199-c3aa-4875-826a-21b8190862ca tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1318 microversion: 2.1 time: 0.170964 Feb 08 16:43:53.139986 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 188/378] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:52 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:53.575001 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-f6fcaee0-271f-4452-bbb6-c2b56b03ca0b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:53.575534 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-f6fcaee0-271f-4452-bbb6-c2b56b03ca0b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:53.581342 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f6fcaee0-271f-4452-bbb6-c2b56b03ca0b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:53.581793 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f6fcaee0-271f-4452-bbb6-c2b56b03ca0b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:53.582572 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f6fcaee0-271f-4452-bbb6-c2b56b03ca0b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:53.583008 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f6fcaee0-271f-4452-bbb6-c2b56b03ca0b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:53.714804 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-f6fcaee0-271f-4452-bbb6-c2b56b03ca0b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:53.722095 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-f6fcaee0-271f-4452-bbb6-c2b56b03ca0b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.151663 Feb 08 16:43:53.722660 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 191/379] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:53 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:54.155602 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-9f3ff227-396d-4860-8d8c-6c2f774e10c2 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:54.156262 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-9f3ff227-396d-4860-8d8c-6c2f774e10c2 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:54.162235 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9f3ff227-396d-4860-8d8c-6c2f774e10c2 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:54.162686 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9f3ff227-396d-4860-8d8c-6c2f774e10c2 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:54.163473 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9f3ff227-396d-4860-8d8c-6c2f774e10c2 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:54.163981 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9f3ff227-396d-4860-8d8c-6c2f774e10c2 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:54.300165 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-9f3ff227-396d-4860-8d8c-6c2f774e10c2 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:54.311324 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-9f3ff227-396d-4860-8d8c-6c2f774e10c2 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1318 microversion: 2.1 time: 0.155638 Feb 08 16:43:54.311324 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 189/380] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:54 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:54.738202 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-4ba4de96-1173-409b-aa7b-b9f14bee867e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:54.739086 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-4ba4de96-1173-409b-aa7b-b9f14bee867e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:54.746118 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4ba4de96-1173-409b-aa7b-b9f14bee867e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:54.746745 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4ba4de96-1173-409b-aa7b-b9f14bee867e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:54.747669 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4ba4de96-1173-409b-aa7b-b9f14bee867e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:54.748201 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4ba4de96-1173-409b-aa7b-b9f14bee867e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:54.831113 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-281171a3-7976-4e5b-a2a0-b965da83037c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1030708843", "imageRef": "d70d3911-14f2-4cba-9283-bf4bef4fb526", "flavorRef": "452", "networks": [{"uuid": "ec8f7fac-5fb6-486d-81c6-a643c1dc738e"}]}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:43:54.887886 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-4ba4de96-1173-409b-aa7b-b9f14bee867e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:54.888224 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.network.neutron [None req-281171a3-7976-4e5b-a2a0-b965da83037c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] validate_networks() for [('ec8f7fac-5fb6-486d-81c6-a643c1dc738e', None, None, None, None, None)] {{(pid=122901) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 16:43:54.896026 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-4ba4de96-1173-409b-aa7b-b9f14bee867e tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.161437 Feb 08 16:43:54.896598 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 192/381] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:54 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:55.246074 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-281171a3-7976-4e5b-a2a0-b965da83037c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Flavor limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 16:43:55.246564 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-281171a3-7976-4e5b-a2a0-b965da83037c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Image limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 16:43:55.246956 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-281171a3-7976-4e5b-a2a0-b965da83037c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Flavor pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 16:43:55.247363 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-281171a3-7976-4e5b-a2a0-b965da83037c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Image pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 16:43:55.247797 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-281171a3-7976-4e5b-a2a0-b965da83037c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 16:43:55.257369 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-281171a3-7976-4e5b-a2a0-b965da83037c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:55.257815 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-281171a3-7976-4e5b-a2a0-b965da83037c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:55.258626 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-281171a3-7976-4e5b-a2a0-b965da83037c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:55.259066 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-281171a3-7976-4e5b-a2a0-b965da83037c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:55.275905 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-281171a3-7976-4e5b-a2a0-b965da83037c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Getting quotas for project 3b57fcb90a594af1b70daaecbf9efd96. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:43:55.279843 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-281171a3-7976-4e5b-a2a0-b965da83037c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Getting quotas for user a5eff85a200a4a599e0cefe8d681d72d and project 3b57fcb90a594af1b70daaecbf9efd96. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:43:55.291310 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-281171a3-7976-4e5b-a2a0-b965da83037c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Going to run 1 instances... {{(pid=122901) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 16:43:55.293704 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-281171a3-7976-4e5b-a2a0-b965da83037c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d70d3911-14f2-4cba-9283-bf4bef4fb526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122901) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 16:43:55.325599 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-8375c393-55c4-43d2-89aa-eb74e2b839fb tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:55.326215 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-8375c393-55c4-43d2-89aa-eb74e2b839fb tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:55.332358 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8375c393-55c4-43d2-89aa-eb74e2b839fb tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:55.332807 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8375c393-55c4-43d2-89aa-eb74e2b839fb tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:55.333583 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8375c393-55c4-43d2-89aa-eb74e2b839fb tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:55.334025 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8375c393-55c4-43d2-89aa-eb74e2b839fb tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:55.340551 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-281171a3-7976-4e5b-a2a0-b965da83037c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512987 Feb 08 16:43:55.341389 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 190/382] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Feb 8 16:43:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 08 16:43:55.350683 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-51a1327d-9c57-4215-9873-4637f8e39459 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:55.351306 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-51a1327d-9c57-4215-9873-4637f8e39459 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:55.421629 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-51a1327d-9c57-4215-9873-4637f8e39459 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:55.429155 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-51a1327d-9c57-4215-9873-4637f8e39459 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1218 microversion: 2.1 time: 0.081716 Feb 08 16:43:55.429850 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 191/383] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:55 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:55.487899 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-8375c393-55c4-43d2-89aa-eb74e2b839fb tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:55.498751 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-8375c393-55c4-43d2-89aa-eb74e2b839fb tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1318 microversion: 2.1 time: 0.177412 Feb 08 16:43:55.499507 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 193/384] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:55 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:55.912755 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ca77be3f-4336-4c72-88e4-2b6352cb62d0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:55.913605 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-ca77be3f-4336-4c72-88e4-2b6352cb62d0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:55.920252 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ca77be3f-4336-4c72-88e4-2b6352cb62d0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:55.920933 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ca77be3f-4336-4c72-88e4-2b6352cb62d0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:55.922229 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ca77be3f-4336-4c72-88e4-2b6352cb62d0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:55.922700 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ca77be3f-4336-4c72-88e4-2b6352cb62d0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:56.064730 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ca77be3f-4336-4c72-88e4-2b6352cb62d0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:56.072351 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-ca77be3f-4336-4c72-88e4-2b6352cb62d0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.163252 Feb 08 16:43:56.072926 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 192/385] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:55 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:56.446046 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-9263eff5-48c8-4a65-8bcc-746d33ccf143 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:56.448350 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-9263eff5-48c8-4a65-8bcc-746d33ccf143 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:56.456532 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9263eff5-48c8-4a65-8bcc-746d33ccf143 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:56.456985 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9263eff5-48c8-4a65-8bcc-746d33ccf143 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:56.458519 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9263eff5-48c8-4a65-8bcc-746d33ccf143 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:56.459048 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9263eff5-48c8-4a65-8bcc-746d33ccf143 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:56.517759 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-88975cb7-c648-4a8e-9220-9b6f9a738cbf tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:56.519455 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-88975cb7-c648-4a8e-9220-9b6f9a738cbf tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:56.530544 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9263eff5-48c8-4a65-8bcc-746d33ccf143 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:56.538017 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-9263eff5-48c8-4a65-8bcc-746d33ccf143 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1288 microversion: 2.1 time: 0.096136 Feb 08 16:43:56.539033 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 194/386] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:56 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1288 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:56.568881 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-88975cb7-c648-4a8e-9220-9b6f9a738cbf tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:56.571184 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-88975cb7-c648-4a8e-9220-9b6f9a738cbf tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:56.572509 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-88975cb7-c648-4a8e-9220-9b6f9a738cbf tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:56.574401 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-88975cb7-c648-4a8e-9220-9b6f9a738cbf tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:56.886919 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-88975cb7-c648-4a8e-9220-9b6f9a738cbf tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:56.897496 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-88975cb7-c648-4a8e-9220-9b6f9a738cbf tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1318 microversion: 2.1 time: 0.384702 Feb 08 16:43:56.898818 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 193/387] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:56 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:57.089768 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-79323b99-73c9-4474-bd55-42f2b86c607b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:57.090415 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-79323b99-73c9-4474-bd55-42f2b86c607b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:57.098651 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-79323b99-73c9-4474-bd55-42f2b86c607b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:57.099093 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-79323b99-73c9-4474-bd55-42f2b86c607b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:57.103672 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-79323b99-73c9-4474-bd55-42f2b86c607b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:57.105447 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-79323b99-73c9-4474-bd55-42f2b86c607b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:57.292536 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-79323b99-73c9-4474-bd55-42f2b86c607b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:57.301517 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-79323b99-73c9-4474-bd55-42f2b86c607b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.216603 Feb 08 16:43:57.302933 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 195/388] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:57 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:57.556228 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-2fc0e455-c371-4e82-ba59-bc853ab6f5d7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:57.557686 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-2fc0e455-c371-4e82-ba59-bc853ab6f5d7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:57.566183 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2fc0e455-c371-4e82-ba59-bc853ab6f5d7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:57.567662 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2fc0e455-c371-4e82-ba59-bc853ab6f5d7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:57.569273 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2fc0e455-c371-4e82-ba59-bc853ab6f5d7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:57.569273 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2fc0e455-c371-4e82-ba59-bc853ab6f5d7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:57.917611 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e7671d0e-a1b9-4428-bec1-2557b8cb5380 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:57.919119 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e7671d0e-a1b9-4428-bec1-2557b8cb5380 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:57.929788 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e7671d0e-a1b9-4428-bec1-2557b8cb5380 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:57.932043 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e7671d0e-a1b9-4428-bec1-2557b8cb5380 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:57.933302 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e7671d0e-a1b9-4428-bec1-2557b8cb5380 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:57.933955 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e7671d0e-a1b9-4428-bec1-2557b8cb5380 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:57.978460 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-2fc0e455-c371-4e82-ba59-bc853ab6f5d7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:57.987036 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-2fc0e455-c371-4e82-ba59-bc853ab6f5d7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1318 microversion: 2.1 time: 0.436536 Feb 08 16:43:57.999788 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 194/389] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:57 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1318 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:58.131343 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e7671d0e-a1b9-4428-bec1-2557b8cb5380 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:58.141661 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e7671d0e-a1b9-4428-bec1-2557b8cb5380 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1318 microversion: 2.1 time: 0.230984 Feb 08 16:43:58.142246 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 196/390] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:57 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:58.320340 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-84e1e128-a227-4068-aa60-7d45b3781bec tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:58.321000 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-84e1e128-a227-4068-aa60-7d45b3781bec tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:58.327839 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-84e1e128-a227-4068-aa60-7d45b3781bec tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:58.328320 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-84e1e128-a227-4068-aa60-7d45b3781bec tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:58.329157 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-84e1e128-a227-4068-aa60-7d45b3781bec tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:58.329590 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-84e1e128-a227-4068-aa60-7d45b3781bec tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:58.656227 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-84e1e128-a227-4068-aa60-7d45b3781bec tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:58.667220 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-84e1e128-a227-4068-aa60-7d45b3781bec tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.350134 Feb 08 16:43:58.668248 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 195/391] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:58 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:58.731364 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-d2e29ac6-7742-4137-9097-87409a0f2b3c req-6510da0a-502b-4dcf-8942-7c4d52df9314 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34aed937-6496-4bee-8f85-9ac16933bed9", "tag": "5bf7187c-608b-4223-8eb8-d0779f39ffb8"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:43:58.733041 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:43:58.733041 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:43:58.741421 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-d2e29ac6-7742-4137-9097-87409a0f2b3c req-6510da0a-502b-4dcf-8942-7c4d52df9314 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:58.742315 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-d2e29ac6-7742-4137-9097-87409a0f2b3c req-6510da0a-502b-4dcf-8942-7c4d52df9314 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:58.761597 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-d2e29ac6-7742-4137-9097-87409a0f2b3c req-6510da0a-502b-4dcf-8942-7c4d52df9314 service nova] Creating event network-changed:5bf7187c-608b-4223-8eb8-d0779f39ffb8 for instance 34aed937-6496-4bee-8f85-9ac16933bed9 on hv-cinder-82786 Feb 08 16:43:58.767277 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-d2e29ac6-7742-4137-9097-87409a0f2b3c req-6510da0a-502b-4dcf-8942-7c4d52df9314 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041593 Feb 08 16:43:58.768606 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 197/392] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:43:59.005296 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d8101a6c-d81f-472e-ba53-e882109691ab tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:59.006281 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-d8101a6c-d81f-472e-ba53-e882109691ab tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:59.014008 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d8101a6c-d81f-472e-ba53-e882109691ab tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:59.014732 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d8101a6c-d81f-472e-ba53-e882109691ab tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:59.015730 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d8101a6c-d81f-472e-ba53-e882109691ab tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:59.016404 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d8101a6c-d81f-472e-ba53-e882109691ab tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:59.158932 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e9a04db3-4f30-4f59-a575-e44fd7613d65 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:59.160279 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e9a04db3-4f30-4f59-a575-e44fd7613d65 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:59.168119 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e9a04db3-4f30-4f59-a575-e44fd7613d65 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:59.168921 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e9a04db3-4f30-4f59-a575-e44fd7613d65 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:59.169932 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e9a04db3-4f30-4f59-a575-e44fd7613d65 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:59.170571 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e9a04db3-4f30-4f59-a575-e44fd7613d65 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:59.251177 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d8101a6c-d81f-472e-ba53-e882109691ab tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:59.271933 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d8101a6c-d81f-472e-ba53-e882109691ab tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1318 microversion: 2.1 time: 0.270285 Feb 08 16:43:59.273213 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 196/393] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:59 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:43:59.434599 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e9a04db3-4f30-4f59-a575-e44fd7613d65 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:43:59.445755 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e9a04db3-4f30-4f59-a575-e44fd7613d65 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1318 microversion: 2.1 time: 0.290253 Feb 08 16:43:59.447715 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 198/394] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:59 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:43:59.690914 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-7e45a45b-f168-43a4-95d7-b73b62c61916 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:43:59.691523 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7e45a45b-f168-43a4-95d7-b73b62c61916 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:43:59.717346 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7e45a45b-f168-43a4-95d7-b73b62c61916 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:59.727292 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7e45a45b-f168-43a4-95d7-b73b62c61916 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:43:59.728740 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7e45a45b-f168-43a4-95d7-b73b62c61916 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:43:59.729138 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7e45a45b-f168-43a4-95d7-b73b62c61916 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:00.021668 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7e45a45b-f168-43a4-95d7-b73b62c61916 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:00.031246 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-7e45a45b-f168-43a4-95d7-b73b62c61916 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.345996 Feb 08 16:44:00.032266 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 197/395] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:43:59 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:00.289011 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-44d5e72a-18f3-4fc3-841b-edc9dc1b4431 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:00.289680 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-44d5e72a-18f3-4fc3-841b-edc9dc1b4431 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:00.296640 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-44d5e72a-18f3-4fc3-841b-edc9dc1b4431 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:00.297095 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-44d5e72a-18f3-4fc3-841b-edc9dc1b4431 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:00.297874 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-44d5e72a-18f3-4fc3-841b-edc9dc1b4431 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:00.298313 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-44d5e72a-18f3-4fc3-841b-edc9dc1b4431 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:00.463543 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b116afcf-5aa2-4285-a8a3-1f3ce099858e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:00.464222 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-b116afcf-5aa2-4285-a8a3-1f3ce099858e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:00.470636 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b116afcf-5aa2-4285-a8a3-1f3ce099858e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:00.471087 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b116afcf-5aa2-4285-a8a3-1f3ce099858e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:00.471915 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b116afcf-5aa2-4285-a8a3-1f3ce099858e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:00.472351 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b116afcf-5aa2-4285-a8a3-1f3ce099858e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:00.543836 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-44d5e72a-18f3-4fc3-841b-edc9dc1b4431 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:00.551920 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-44d5e72a-18f3-4fc3-841b-edc9dc1b4431 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1318 microversion: 2.1 time: 0.266590 Feb 08 16:44:00.562165 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 199/396] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:00 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:00.624549 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-b116afcf-5aa2-4285-a8a3-1f3ce099858e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:00.632418 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-b116afcf-5aa2-4285-a8a3-1f3ce099858e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1318 microversion: 2.1 time: 0.172468 Feb 08 16:44:00.632995 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 198/397] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:00 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:44:01.048978 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e6d88747-2c1e-4f4a-ba54-33142ba23e2a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:01.049770 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e6d88747-2c1e-4f4a-ba54-33142ba23e2a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:01.056885 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e6d88747-2c1e-4f4a-ba54-33142ba23e2a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:01.057618 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e6d88747-2c1e-4f4a-ba54-33142ba23e2a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:01.058521 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e6d88747-2c1e-4f4a-ba54-33142ba23e2a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:01.059056 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e6d88747-2c1e-4f4a-ba54-33142ba23e2a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:01.533047 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e6d88747-2c1e-4f4a-ba54-33142ba23e2a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:01.540894 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e6d88747-2c1e-4f4a-ba54-33142ba23e2a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.495805 Feb 08 16:44:01.541698 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 200/398] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:01 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:01.569280 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-7ccd9e2c-a47d-4a92-9d12-d0408cd5d46d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:01.570034 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7ccd9e2c-a47d-4a92-9d12-d0408cd5d46d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:01.577127 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7ccd9e2c-a47d-4a92-9d12-d0408cd5d46d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:01.577705 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7ccd9e2c-a47d-4a92-9d12-d0408cd5d46d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:01.578615 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7ccd9e2c-a47d-4a92-9d12-d0408cd5d46d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:01.579272 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7ccd9e2c-a47d-4a92-9d12-d0408cd5d46d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:01.651676 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-4df374a7-cbd4-4d49-b116-43224c9a8da4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:01.653229 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-4df374a7-cbd4-4d49-b116-43224c9a8da4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:01.662269 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4df374a7-cbd4-4d49-b116-43224c9a8da4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:01.664618 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4df374a7-cbd4-4d49-b116-43224c9a8da4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:01.665686 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4df374a7-cbd4-4d49-b116-43224c9a8da4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:01.666408 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4df374a7-cbd4-4d49-b116-43224c9a8da4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:01.959743 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-4df374a7-cbd4-4d49-b116-43224c9a8da4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:01.968151 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-4df374a7-cbd4-4d49-b116-43224c9a8da4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1318 microversion: 2.1 time: 0.321627 Feb 08 16:44:01.983550 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 201/399] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:01 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:02.032780 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7ccd9e2c-a47d-4a92-9d12-d0408cd5d46d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:02.041621 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-7ccd9e2c-a47d-4a92-9d12-d0408cd5d46d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1318 microversion: 2.1 time: 0.475750 Feb 08 16:44:02.042845 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 199/400] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:01 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:44:02.142072 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-a632885d-42e1-481b-bbae-79fa7d4ec2e5 req-46a2bff0-70d9-42cd-b029-b73e87401f3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66ad307-27dc-4150-b8c8-fe488dca0906", "name": "network-vif-plugged", "status": "completed", "tag": "7b51cb9a-da70-41bd-8fd9-16b61091a7c2"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:44:02.146590 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:44:02.146590 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:44:02.162939 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-a632885d-42e1-481b-bbae-79fa7d4ec2e5 req-46a2bff0-70d9-42cd-b029-b73e87401f3c service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:02.164192 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-a632885d-42e1-481b-bbae-79fa7d4ec2e5 req-46a2bff0-70d9-42cd-b029-b73e87401f3c service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:02.181103 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-a632885d-42e1-481b-bbae-79fa7d4ec2e5 req-46a2bff0-70d9-42cd-b029-b73e87401f3c service nova] Creating event network-vif-plugged:7b51cb9a-da70-41bd-8fd9-16b61091a7c2 for instance b66ad307-27dc-4150-b8c8-fe488dca0906 on hv-cinder-82786 Feb 08 16:44:02.187118 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-a632885d-42e1-481b-bbae-79fa7d4ec2e5 req-46a2bff0-70d9-42cd-b029-b73e87401f3c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052902 Feb 08 16:44:02.188736 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 202/401] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:44:02.564344 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-40b4f2c1-c2b1-4a61-91e2-ae311a72567a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:02.565048 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-40b4f2c1-c2b1-4a61-91e2-ae311a72567a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:02.579403 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-40b4f2c1-c2b1-4a61-91e2-ae311a72567a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:02.580183 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-40b4f2c1-c2b1-4a61-91e2-ae311a72567a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:02.582626 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-40b4f2c1-c2b1-4a61-91e2-ae311a72567a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:02.584313 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-40b4f2c1-c2b1-4a61-91e2-ae311a72567a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:02.751926 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-40b4f2c1-c2b1-4a61-91e2-ae311a72567a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:02.761000 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-40b4f2c1-c2b1-4a61-91e2-ae311a72567a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.205266 Feb 08 16:44:02.761786 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 200/402] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:02 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:02.990433 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-ca0b0703-5bee-4776-b6b8-4c993e14480e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:02.991318 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-ca0b0703-5bee-4776-b6b8-4c993e14480e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:03.000974 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ca0b0703-5bee-4776-b6b8-4c993e14480e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:03.001510 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ca0b0703-5bee-4776-b6b8-4c993e14480e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:03.002378 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ca0b0703-5bee-4776-b6b8-4c993e14480e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:03.003187 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ca0b0703-5bee-4776-b6b8-4c993e14480e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:03.059090 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-cc9d1483-e6d7-4eb5-a237-78c21faea507 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:03.059703 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-cc9d1483-e6d7-4eb5-a237-78c21faea507 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:03.066149 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cc9d1483-e6d7-4eb5-a237-78c21faea507 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:03.066815 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cc9d1483-e6d7-4eb5-a237-78c21faea507 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:03.067797 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cc9d1483-e6d7-4eb5-a237-78c21faea507 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:03.068398 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cc9d1483-e6d7-4eb5-a237-78c21faea507 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:03.204556 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ca0b0703-5bee-4776-b6b8-4c993e14480e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:03.214282 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-ca0b0703-5bee-4776-b6b8-4c993e14480e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1318 microversion: 2.1 time: 0.233138 Feb 08 16:44:03.214875 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 203/403] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:02 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:03.253949 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-cc9d1483-e6d7-4eb5-a237-78c21faea507 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:03.262024 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-cc9d1483-e6d7-4eb5-a237-78c21faea507 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1318 microversion: 2.1 time: 0.207529 Feb 08 16:44:03.266805 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 201/404] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:03 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:44:03.778937 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-7b24d29b-df24-476e-8147-2a3f726f462a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:03.779570 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-7b24d29b-df24-476e-8147-2a3f726f462a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:03.786681 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7b24d29b-df24-476e-8147-2a3f726f462a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:03.787139 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7b24d29b-df24-476e-8147-2a3f726f462a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:03.787962 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7b24d29b-df24-476e-8147-2a3f726f462a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:03.788407 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7b24d29b-df24-476e-8147-2a3f726f462a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:04.020250 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-7b24d29b-df24-476e-8147-2a3f726f462a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:04.029585 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-7b24d29b-df24-476e-8147-2a3f726f462a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.254824 Feb 08 16:44:04.039143 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 204/405] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:03 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:04.231493 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-febcdd93-77a8-4051-870c-6dd0f3aa7a32 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:04.232412 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-febcdd93-77a8-4051-870c-6dd0f3aa7a32 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:04.239000 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-febcdd93-77a8-4051-870c-6dd0f3aa7a32 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:04.239577 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-febcdd93-77a8-4051-870c-6dd0f3aa7a32 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:04.240663 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-febcdd93-77a8-4051-870c-6dd0f3aa7a32 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:04.241203 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-febcdd93-77a8-4051-870c-6dd0f3aa7a32 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:04.278573 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-9a943c0c-6983-4faf-9281-b02b928d5e11 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:04.279526 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-9a943c0c-6983-4faf-9281-b02b928d5e11 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:04.292393 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9a943c0c-6983-4faf-9281-b02b928d5e11 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:04.293121 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9a943c0c-6983-4faf-9281-b02b928d5e11 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:04.294363 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9a943c0c-6983-4faf-9281-b02b928d5e11 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:04.296637 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9a943c0c-6983-4faf-9281-b02b928d5e11 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:04.472235 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9a943c0c-6983-4faf-9281-b02b928d5e11 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:04.483545 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-9a943c0c-6983-4faf-9281-b02b928d5e11 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1318 microversion: 2.1 time: 0.208973 Feb 08 16:44:04.484466 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 205/406] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:04 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:04.564067 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-febcdd93-77a8-4051-870c-6dd0f3aa7a32 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:04.573287 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-febcdd93-77a8-4051-870c-6dd0f3aa7a32 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1318 microversion: 2.1 time: 0.346050 Feb 08 16:44:04.574794 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 202/407] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:04 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:05.046235 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-0d0e362a-4f40-42e6-b94c-9c356ed607eb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:05.047124 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-0d0e362a-4f40-42e6-b94c-9c356ed607eb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:05.053302 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0d0e362a-4f40-42e6-b94c-9c356ed607eb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:05.054470 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0d0e362a-4f40-42e6-b94c-9c356ed607eb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:05.054865 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0d0e362a-4f40-42e6-b94c-9c356ed607eb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:05.055939 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0d0e362a-4f40-42e6-b94c-9c356ed607eb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:05.224400 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-0d0e362a-4f40-42e6-b94c-9c356ed607eb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:05.237377 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-0d0e362a-4f40-42e6-b94c-9c356ed607eb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.194846 Feb 08 16:44:05.249372 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 206/408] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:05 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:05.507623 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-5ea59016-7209-4abd-93f7-02513b77dd22 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:05.508326 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-5ea59016-7209-4abd-93f7-02513b77dd22 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:05.515381 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5ea59016-7209-4abd-93f7-02513b77dd22 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:05.515975 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5ea59016-7209-4abd-93f7-02513b77dd22 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:05.518647 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5ea59016-7209-4abd-93f7-02513b77dd22 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:05.519161 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5ea59016-7209-4abd-93f7-02513b77dd22 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:05.591105 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-0b52b2db-5352-41f1-91b9-de2dbf8f1a69 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:05.592014 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-0b52b2db-5352-41f1-91b9-de2dbf8f1a69 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:05.598147 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0b52b2db-5352-41f1-91b9-de2dbf8f1a69 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:05.598804 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0b52b2db-5352-41f1-91b9-de2dbf8f1a69 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:05.599783 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0b52b2db-5352-41f1-91b9-de2dbf8f1a69 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:05.600392 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0b52b2db-5352-41f1-91b9-de2dbf8f1a69 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:05.793569 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-0b52b2db-5352-41f1-91b9-de2dbf8f1a69 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:05.800843 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-0b52b2db-5352-41f1-91b9-de2dbf8f1a69 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1318 microversion: 2.1 time: 0.214171 Feb 08 16:44:05.801921 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 207/409] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:05 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:05.802658 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-5ea59016-7209-4abd-93f7-02513b77dd22 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:05.829391 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-5ea59016-7209-4abd-93f7-02513b77dd22 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1318 microversion: 2.1 time: 0.332229 Feb 08 16:44:05.830117 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 203/410] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:05 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:06.255509 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-88ed868a-dc58-4438-aa4e-b3b7cf25415b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:06.256578 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-88ed868a-dc58-4438-aa4e-b3b7cf25415b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:06.267568 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-88ed868a-dc58-4438-aa4e-b3b7cf25415b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:06.268359 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-88ed868a-dc58-4438-aa4e-b3b7cf25415b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:06.269362 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-88ed868a-dc58-4438-aa4e-b3b7cf25415b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:06.270217 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-88ed868a-dc58-4438-aa4e-b3b7cf25415b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:06.460119 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-88ed868a-dc58-4438-aa4e-b3b7cf25415b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:06.468547 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-88ed868a-dc58-4438-aa4e-b3b7cf25415b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.216583 Feb 08 16:44:06.469663 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 208/411] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:06 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:06.818407 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-c6fabf0b-1367-4872-b8af-b980268cafb4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:06.822369 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-c6fabf0b-1367-4872-b8af-b980268cafb4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:06.839417 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c6fabf0b-1367-4872-b8af-b980268cafb4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:06.840309 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c6fabf0b-1367-4872-b8af-b980268cafb4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:06.849806 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c7deb599-b14e-479f-8fb6-61095c1d0097 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:06.850802 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c7deb599-b14e-479f-8fb6-61095c1d0097 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:06.857979 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c6fabf0b-1367-4872-b8af-b980268cafb4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:06.858844 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c6fabf0b-1367-4872-b8af-b980268cafb4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:06.868797 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c7deb599-b14e-479f-8fb6-61095c1d0097 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:06.872488 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c7deb599-b14e-479f-8fb6-61095c1d0097 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:06.873446 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c7deb599-b14e-479f-8fb6-61095c1d0097 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:06.880608 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c7deb599-b14e-479f-8fb6-61095c1d0097 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:07.081934 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c7deb599-b14e-479f-8fb6-61095c1d0097 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:07.094390 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c7deb599-b14e-479f-8fb6-61095c1d0097 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1318 microversion: 2.1 time: 0.251565 Feb 08 16:44:07.095248 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 209/412] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:06 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:44:07.489265 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-3b722866-54cf-4e6c-a199-c50ad898778c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:07.498470 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-3b722866-54cf-4e6c-a199-c50ad898778c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:07.517166 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3b722866-54cf-4e6c-a199-c50ad898778c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:07.521214 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3b722866-54cf-4e6c-a199-c50ad898778c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:07.527350 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3b722866-54cf-4e6c-a199-c50ad898778c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:07.528402 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3b722866-54cf-4e6c-a199-c50ad898778c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:07.544890 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c6fabf0b-1367-4872-b8af-b980268cafb4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:07.553424 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-c6fabf0b-1367-4872-b8af-b980268cafb4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1318 microversion: 2.1 time: 0.738582 Feb 08 16:44:07.567267 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 204/413] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:06 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1318 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:07.815084 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3b722866-54cf-4e6c-a199-c50ad898778c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:07.824177 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-3b722866-54cf-4e6c-a199-c50ad898778c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.341997 Feb 08 16:44:07.834478 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 210/414] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:07 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:08.112125 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-73ef3e16-bce9-4c1e-bc2f-a65ad9320903 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:08.112706 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-73ef3e16-bce9-4c1e-bc2f-a65ad9320903 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:08.124446 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-73ef3e16-bce9-4c1e-bc2f-a65ad9320903 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:08.130790 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-73ef3e16-bce9-4c1e-bc2f-a65ad9320903 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:08.131868 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-73ef3e16-bce9-4c1e-bc2f-a65ad9320903 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:08.132319 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-73ef3e16-bce9-4c1e-bc2f-a65ad9320903 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:08.460397 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-73ef3e16-bce9-4c1e-bc2f-a65ad9320903 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:08.473371 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-73ef3e16-bce9-4c1e-bc2f-a65ad9320903 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1318 microversion: 2.1 time: 0.365430 Feb 08 16:44:08.483777 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 205/415] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:08 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:08.571793 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-a6ed9bf9-2620-4db4-84aa-b75ccf107b47 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:08.572547 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-a6ed9bf9-2620-4db4-84aa-b75ccf107b47 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:08.585126 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a6ed9bf9-2620-4db4-84aa-b75ccf107b47 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:08.585968 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a6ed9bf9-2620-4db4-84aa-b75ccf107b47 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:08.587571 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a6ed9bf9-2620-4db4-84aa-b75ccf107b47 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:08.589117 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a6ed9bf9-2620-4db4-84aa-b75ccf107b47 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:08.798327 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-a6ed9bf9-2620-4db4-84aa-b75ccf107b47 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:08.812116 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-a6ed9bf9-2620-4db4-84aa-b75ccf107b47 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1318 microversion: 2.1 time: 0.245384 Feb 08 16:44:08.816918 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 211/416] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:08 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:08.841024 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e2c25186-fe32-4924-a59e-c097d60a8fe5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:08.841927 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e2c25186-fe32-4924-a59e-c097d60a8fe5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:08.848201 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e2c25186-fe32-4924-a59e-c097d60a8fe5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:08.850618 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e2c25186-fe32-4924-a59e-c097d60a8fe5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:08.854143 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e2c25186-fe32-4924-a59e-c097d60a8fe5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:08.854606 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e2c25186-fe32-4924-a59e-c097d60a8fe5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:09.079179 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e2c25186-fe32-4924-a59e-c097d60a8fe5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:09.087252 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e2c25186-fe32-4924-a59e-c097d60a8fe5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.250015 Feb 08 16:44:09.096901 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 206/417] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:08 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:09.332252 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-36a10886-5837-4886-9e5e-b747b2fa4faa tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Action: 'create', calling method: .version_select at 0x7fcde0cff550>, body: {"keypair": {"name": "tempest-TestShelveInstance-887258110"}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:44:09.350713 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-36a10886-5837-4886-9e5e-b747b2fa4faa tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Getting quotas for project 08bc94fd80244144ae5883c54707e219. Resources: {'key_pairs'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:44:09.355239 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-36a10886-5837-4886-9e5e-b747b2fa4faa tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Getting quotas for user 89bb4f5ad936444093f3115c65c441b1 and project 08bc94fd80244144ae5883c54707e219. Resources: {'key_pairs'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:44:09.490017 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-c8f17d18-43d5-4790-8c27-70b985290774 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:09.490747 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-c8f17d18-43d5-4790-8c27-70b985290774 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:09.497031 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c8f17d18-43d5-4790-8c27-70b985290774 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:09.497484 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c8f17d18-43d5-4790-8c27-70b985290774 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:09.498265 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c8f17d18-43d5-4790-8c27-70b985290774 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:09.498704 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c8f17d18-43d5-4790-8c27-70b985290774 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:09.636259 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c8f17d18-43d5-4790-8c27-70b985290774 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:09.643590 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-c8f17d18-43d5-4790-8c27-70b985290774 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1318 microversion: 2.1 time: 0.157119 Feb 08 16:44:09.644251 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 207/418] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:09 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:44:09.659964 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-36a10886-5837-4886-9e5e-b747b2fa4faa tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Getting quotas for project 08bc94fd80244144ae5883c54707e219. Resources: {'key_pairs'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:44:09.663595 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-36a10886-5837-4886-9e5e-b747b2fa4faa tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Getting quotas for user 89bb4f5ad936444093f3115c65c441b1 and project 08bc94fd80244144ae5883c54707e219. Resources: {'key_pairs'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:44:09.676943 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-36a10886-5837-4886-9e5e-b747b2fa4faa tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.526103 Feb 08 16:44:09.677539 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 212/419] 10.222.0.35 () {60 vars in 1157 bytes} [Tue Feb 8 16:44:09 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:09.834580 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-6f898ac4-6ad2-4c50-b243-d7928345eaaa tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:09.835201 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-6f898ac4-6ad2-4c50-b243-d7928345eaaa tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:09.842812 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6f898ac4-6ad2-4c50-b243-d7928345eaaa tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:09.843267 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6f898ac4-6ad2-4c50-b243-d7928345eaaa tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:09.844410 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6f898ac4-6ad2-4c50-b243-d7928345eaaa tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:09.844854 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6f898ac4-6ad2-4c50-b243-d7928345eaaa tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:10.058725 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-6f898ac4-6ad2-4c50-b243-d7928345eaaa tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:10.067577 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-6f898ac4-6ad2-4c50-b243-d7928345eaaa tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1318 microversion: 2.1 time: 0.237000 Feb 08 16:44:10.068948 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 208/420] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:09 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:10.104858 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-d84c391e-a600-4441-a52d-b8de97e9526f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:10.105474 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-d84c391e-a600-4441-a52d-b8de97e9526f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:10.112634 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d84c391e-a600-4441-a52d-b8de97e9526f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:10.113091 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d84c391e-a600-4441-a52d-b8de97e9526f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:10.113961 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d84c391e-a600-4441-a52d-b8de97e9526f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:10.114405 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d84c391e-a600-4441-a52d-b8de97e9526f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:10.298042 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-d84c391e-a600-4441-a52d-b8de97e9526f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:10.305693 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-d84c391e-a600-4441-a52d-b8de97e9526f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.204400 Feb 08 16:44:10.306662 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 213/421] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:10 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:10.662022 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ca538bf9-2422-4f9f-8aaa-a95480efaac0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:10.662629 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-ca538bf9-2422-4f9f-8aaa-a95480efaac0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:10.669088 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ca538bf9-2422-4f9f-8aaa-a95480efaac0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:10.669611 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ca538bf9-2422-4f9f-8aaa-a95480efaac0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:10.670624 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ca538bf9-2422-4f9f-8aaa-a95480efaac0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:10.671155 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ca538bf9-2422-4f9f-8aaa-a95480efaac0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:10.840944 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ca538bf9-2422-4f9f-8aaa-a95480efaac0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:10.849118 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-ca538bf9-2422-4f9f-8aaa-a95480efaac0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1318 microversion: 2.1 time: 0.190589 Feb 08 16:44:10.849859 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 209/422] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:10 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:11.084869 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-65753d82-1e24-41b5-9539-4c23fa6a05b4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:11.085525 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-65753d82-1e24-41b5-9539-4c23fa6a05b4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:11.092184 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-65753d82-1e24-41b5-9539-4c23fa6a05b4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:11.092833 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-65753d82-1e24-41b5-9539-4c23fa6a05b4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:11.093799 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-65753d82-1e24-41b5-9539-4c23fa6a05b4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:11.094411 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-65753d82-1e24-41b5-9539-4c23fa6a05b4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:11.314102 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-65753d82-1e24-41b5-9539-4c23fa6a05b4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:11.324740 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-965c70c1-5469-494b-b44c-28838540387c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:11.326536 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-965c70c1-5469-494b-b44c-28838540387c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:11.338027 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-65753d82-1e24-41b5-9539-4c23fa6a05b4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1318 microversion: 2.1 time: 0.256606 Feb 08 16:44:11.339363 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 214/423] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:11 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:44:11.342170 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-965c70c1-5469-494b-b44c-28838540387c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:11.344699 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-965c70c1-5469-494b-b44c-28838540387c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:11.347096 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-965c70c1-5469-494b-b44c-28838540387c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:11.348154 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-965c70c1-5469-494b-b44c-28838540387c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:11.517564 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-965c70c1-5469-494b-b44c-28838540387c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:11.527332 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-965c70c1-5469-494b-b44c-28838540387c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1500 microversion: 2.1 time: 0.207219 Feb 08 16:44:11.528517 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 210/424] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:11 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1500 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:11.545469 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-316795d1-581a-4fcd-bf6c-f515bcfeeb8d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "672c78fd-3e89-4157-a811-3f30f1e39297"}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:44:11.546582 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-316795d1-581a-4fcd-bf6c-f515bcfeeb8d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:11.552714 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-316795d1-581a-4fcd-bf6c-f515bcfeeb8d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:11.553161 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-316795d1-581a-4fcd-bf6c-f515bcfeeb8d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:11.553936 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-316795d1-581a-4fcd-bf6c-f515bcfeeb8d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:11.554534 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-316795d1-581a-4fcd-bf6c-f515bcfeeb8d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:11.584790 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-316795d1-581a-4fcd-bf6c-f515bcfeeb8d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] HTTP exception thrown: Cannot 'attach_volume' instance 46b82748-ebae-4771-b414-3feb285df38d while it is in vm_state rescued Feb 08 16:44:11.585407 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-316795d1-581a-4fcd-bf6c-f515bcfeeb8d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Returning 409 to user: Cannot 'attach_volume' instance 46b82748-ebae-4771-b414-3feb285df38d while it is in vm_state rescued {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:44:11.587002 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-316795d1-581a-4fcd-bf6c-f515bcfeeb8d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "POST /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045480 Feb 08 16:44:11.587537 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 215/425] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Feb 8 16:44:11 2022] POST /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 08 16:44:11.598995 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-c5804f20-7f0a-4195-a97b-dcc7b485ae5b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:44:11.599536 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-c5804f20-7f0a-4195-a97b-dcc7b485ae5b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:11.606507 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c5804f20-7f0a-4195-a97b-dcc7b485ae5b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:11.606975 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c5804f20-7f0a-4195-a97b-dcc7b485ae5b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:11.607912 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c5804f20-7f0a-4195-a97b-dcc7b485ae5b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:11.608628 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c5804f20-7f0a-4195-a97b-dcc7b485ae5b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:11.752429 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-c5804f20-7f0a-4195-a97b-dcc7b485ae5b tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "POST /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d/action" status: 202 len: 0 microversion: 2.1 time: 0.159385 Feb 08 16:44:11.753433 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 211/426] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Feb 8 16:44:11 2022] POST /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:44:11.763297 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-0139d924-2330-4655-b974-ab92ff886c92 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:11.763979 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-0139d924-2330-4655-b974-ab92ff886c92 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:11.773500 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0139d924-2330-4655-b974-ab92ff886c92 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:11.774810 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0139d924-2330-4655-b974-ab92ff886c92 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:11.776894 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0139d924-2330-4655-b974-ab92ff886c92 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:11.777613 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0139d924-2330-4655-b974-ab92ff886c92 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:11.866297 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-76d37a05-5a97-4aaa-af03-89a2fb345bd7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:11.867253 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-76d37a05-5a97-4aaa-af03-89a2fb345bd7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:11.874439 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-76d37a05-5a97-4aaa-af03-89a2fb345bd7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:11.875024 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-76d37a05-5a97-4aaa-af03-89a2fb345bd7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:11.876458 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-76d37a05-5a97-4aaa-af03-89a2fb345bd7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:11.881639 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-76d37a05-5a97-4aaa-af03-89a2fb345bd7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:12.131191 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-0139d924-2330-4655-b974-ab92ff886c92 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:12.134037 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-76d37a05-5a97-4aaa-af03-89a2fb345bd7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:12.143866 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-0139d924-2330-4655-b974-ab92ff886c92 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1508 microversion: 2.1 time: 0.385782 Feb 08 16:44:12.145005 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 216/427] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:11 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1508 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:12.157652 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-76d37a05-5a97-4aaa-af03-89a2fb345bd7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1318 microversion: 2.1 time: 0.295344 Feb 08 16:44:12.158393 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 212/428] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:11 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:44:12.354584 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-f5e1294c-43b9-4ee9-adef-4281e595132b tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:12.355595 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-f5e1294c-43b9-4ee9-adef-4281e595132b tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:12.361785 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f5e1294c-43b9-4ee9-adef-4281e595132b tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:12.362241 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f5e1294c-43b9-4ee9-adef-4281e595132b tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:12.363028 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f5e1294c-43b9-4ee9-adef-4281e595132b tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:12.363465 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f5e1294c-43b9-4ee9-adef-4281e595132b tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:12.647590 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-f5e1294c-43b9-4ee9-adef-4281e595132b tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:12.659911 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-f5e1294c-43b9-4ee9-adef-4281e595132b tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1507 microversion: 2.1 time: 0.309079 Feb 08 16:44:12.662827 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 217/429] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:12 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1507 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:13.161715 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-40703d2f-84d0-496c-9c01-1f73f1490e2f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:13.163128 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-40703d2f-84d0-496c-9c01-1f73f1490e2f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:13.173309 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-40703d2f-84d0-496c-9c01-1f73f1490e2f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:13.174304 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-40703d2f-84d0-496c-9c01-1f73f1490e2f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:13.174599 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-19a41c5f-03fb-455a-96e6-b7812f840add tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:13.175375 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-19a41c5f-03fb-455a-96e6-b7812f840add tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:13.176012 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-40703d2f-84d0-496c-9c01-1f73f1490e2f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:13.176918 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-40703d2f-84d0-496c-9c01-1f73f1490e2f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:13.183554 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-19a41c5f-03fb-455a-96e6-b7812f840add tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:13.184523 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-19a41c5f-03fb-455a-96e6-b7812f840add tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:13.185570 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-19a41c5f-03fb-455a-96e6-b7812f840add tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:13.187025 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-19a41c5f-03fb-455a-96e6-b7812f840add tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:13.348986 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-40703d2f-84d0-496c-9c01-1f73f1490e2f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:13.367359 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-19a41c5f-03fb-455a-96e6-b7812f840add tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:13.371120 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-40703d2f-84d0-496c-9c01-1f73f1490e2f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1508 microversion: 2.1 time: 0.206336 Feb 08 16:44:13.371727 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 213/430] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:13 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1508 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:13.375510 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-19a41c5f-03fb-455a-96e6-b7812f840add tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1318 microversion: 2.1 time: 0.204934 Feb 08 16:44:13.376114 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 218/431] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:13 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:14.388445 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-993427cb-6030-4d32-9c33-f272178f11c7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:14.389056 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-993427cb-6030-4d32-9c33-f272178f11c7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:14.392364 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-a3edb2ae-1094-4bfa-b78d-ad8e1b10a772 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:14.393016 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-a3edb2ae-1094-4bfa-b78d-ad8e1b10a772 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:14.396552 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-993427cb-6030-4d32-9c33-f272178f11c7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:14.397040 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-993427cb-6030-4d32-9c33-f272178f11c7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:14.397869 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-993427cb-6030-4d32-9c33-f272178f11c7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:14.398304 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-993427cb-6030-4d32-9c33-f272178f11c7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:14.399804 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a3edb2ae-1094-4bfa-b78d-ad8e1b10a772 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:14.400277 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a3edb2ae-1094-4bfa-b78d-ad8e1b10a772 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:14.401206 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a3edb2ae-1094-4bfa-b78d-ad8e1b10a772 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:14.401650 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a3edb2ae-1094-4bfa-b78d-ad8e1b10a772 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:14.538592 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-993427cb-6030-4d32-9c33-f272178f11c7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:14.545178 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-a3edb2ae-1094-4bfa-b78d-ad8e1b10a772 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:14.550797 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-993427cb-6030-4d32-9c33-f272178f11c7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1508 microversion: 2.1 time: 0.166376 Feb 08 16:44:14.551651 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 214/432] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:14 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:14.557940 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-a3edb2ae-1094-4bfa-b78d-ad8e1b10a772 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1318 microversion: 2.1 time: 0.164820 Feb 08 16:44:14.561931 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 219/433] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:14 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:44:15.568068 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-a4c708da-1ba5-4454-9ca3-83c5a1950238 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:15.568778 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-a4c708da-1ba5-4454-9ca3-83c5a1950238 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:15.569928 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-ce38ce80-c88e-44b0-b7d9-4cb32a3917ca tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:15.570542 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-ce38ce80-c88e-44b0-b7d9-4cb32a3917ca tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:15.578663 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ce38ce80-c88e-44b0-b7d9-4cb32a3917ca tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:15.579153 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ce38ce80-c88e-44b0-b7d9-4cb32a3917ca tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:15.579457 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a4c708da-1ba5-4454-9ca3-83c5a1950238 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:15.579989 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ce38ce80-c88e-44b0-b7d9-4cb32a3917ca tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:15.580471 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a4c708da-1ba5-4454-9ca3-83c5a1950238 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:15.580915 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ce38ce80-c88e-44b0-b7d9-4cb32a3917ca tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:15.581602 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a4c708da-1ba5-4454-9ca3-83c5a1950238 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:15.583129 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a4c708da-1ba5-4454-9ca3-83c5a1950238 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:15.743097 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-a4c708da-1ba5-4454-9ca3-83c5a1950238 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:15.749633 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ce38ce80-c88e-44b0-b7d9-4cb32a3917ca tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:15.752779 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-a4c708da-1ba5-4454-9ca3-83c5a1950238 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1508 microversion: 2.1 time: 0.188896 Feb 08 16:44:15.753358 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 215/434] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:15 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:15.760398 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-ce38ce80-c88e-44b0-b7d9-4cb32a3917ca tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1318 microversion: 2.1 time: 0.193518 Feb 08 16:44:15.761060 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 220/435] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:15 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:44:16.771501 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-0ff9506d-a488-4296-893a-9995028da5b7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:16.772428 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-0ff9506d-a488-4296-893a-9995028da5b7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:16.777280 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-39829c35-3046-4bae-9b48-0173e193bc42 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:16.777998 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-39829c35-3046-4bae-9b48-0173e193bc42 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:16.783945 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0ff9506d-a488-4296-893a-9995028da5b7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:16.784390 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0ff9506d-a488-4296-893a-9995028da5b7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:16.785182 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0ff9506d-a488-4296-893a-9995028da5b7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:16.785366 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-39829c35-3046-4bae-9b48-0173e193bc42 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:16.788288 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0ff9506d-a488-4296-893a-9995028da5b7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:16.789012 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-39829c35-3046-4bae-9b48-0173e193bc42 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:16.789012 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-39829c35-3046-4bae-9b48-0173e193bc42 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:16.789012 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-39829c35-3046-4bae-9b48-0173e193bc42 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:16.927578 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0ff9506d-a488-4296-893a-9995028da5b7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:16.928189 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-39829c35-3046-4bae-9b48-0173e193bc42 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:16.935832 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-0ff9506d-a488-4296-893a-9995028da5b7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1514 microversion: 2.1 time: 0.169113 Feb 08 16:44:16.936232 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-39829c35-3046-4bae-9b48-0173e193bc42 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1318 microversion: 2.1 time: 0.163373 Feb 08 16:44:16.936580 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 216/436] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:16 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:16.936871 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 221/437] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:16 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:17.953310 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-73602915-84eb-4c03-ab10-8836d8c5cca6 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:17.953853 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-73602915-84eb-4c03-ab10-8836d8c5cca6 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:17.960064 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-73602915-84eb-4c03-ab10-8836d8c5cca6 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:17.960512 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-73602915-84eb-4c03-ab10-8836d8c5cca6 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:17.961287 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-73602915-84eb-4c03-ab10-8836d8c5cca6 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:17.961716 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-73602915-84eb-4c03-ab10-8836d8c5cca6 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:18.092185 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-73602915-84eb-4c03-ab10-8836d8c5cca6 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:18.099466 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-73602915-84eb-4c03-ab10-8836d8c5cca6 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1318 microversion: 2.1 time: 0.149897 Feb 08 16:44:18.100087 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 217/438] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:17 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:19.116026 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-9cfc27e6-1ea9-487f-9c39-6240636e2f7d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:19.116654 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-9cfc27e6-1ea9-487f-9c39-6240636e2f7d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:19.122585 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9cfc27e6-1ea9-487f-9c39-6240636e2f7d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:19.123027 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9cfc27e6-1ea9-487f-9c39-6240636e2f7d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:19.123816 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9cfc27e6-1ea9-487f-9c39-6240636e2f7d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:19.124246 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9cfc27e6-1ea9-487f-9c39-6240636e2f7d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:19.255780 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9cfc27e6-1ea9-487f-9c39-6240636e2f7d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:19.263411 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-9cfc27e6-1ea9-487f-9c39-6240636e2f7d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1318 microversion: 2.1 time: 0.150982 Feb 08 16:44:19.264185 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 222/439] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:19 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:20.052647 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-1d63abae-871e-4e1f-85e0-784901f8e3d8 req-6d180077-b574-4a8e-9dc4-22fd60c6dcbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34aed937-6496-4bee-8f85-9ac16933bed9", "name": "network-vif-plugged", "status": "completed", "tag": "5bf7187c-608b-4223-8eb8-d0779f39ffb8"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:44:20.054235 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:44:20.054235 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:44:20.062216 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-1d63abae-871e-4e1f-85e0-784901f8e3d8 req-6d180077-b574-4a8e-9dc4-22fd60c6dcbf service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:20.062668 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-1d63abae-871e-4e1f-85e0-784901f8e3d8 req-6d180077-b574-4a8e-9dc4-22fd60c6dcbf service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:20.074320 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-1d63abae-871e-4e1f-85e0-784901f8e3d8 req-6d180077-b574-4a8e-9dc4-22fd60c6dcbf service nova] Creating event network-vif-plugged:5bf7187c-608b-4223-8eb8-d0779f39ffb8 for instance 34aed937-6496-4bee-8f85-9ac16933bed9 on hv-cinder-82786 Feb 08 16:44:20.079520 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-1d63abae-871e-4e1f-85e0-784901f8e3d8 req-6d180077-b574-4a8e-9dc4-22fd60c6dcbf service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030596 Feb 08 16:44:20.080153 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 218/440] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:44:20.279925 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-f104c8f0-a153-4d6a-9bbc-ac1ef013b3d1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:20.280542 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-f104c8f0-a153-4d6a-9bbc-ac1ef013b3d1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:20.286396 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f104c8f0-a153-4d6a-9bbc-ac1ef013b3d1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:20.286846 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f104c8f0-a153-4d6a-9bbc-ac1ef013b3d1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:20.287626 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f104c8f0-a153-4d6a-9bbc-ac1ef013b3d1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:20.288088 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f104c8f0-a153-4d6a-9bbc-ac1ef013b3d1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:20.422946 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-f104c8f0-a153-4d6a-9bbc-ac1ef013b3d1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:20.431784 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-f104c8f0-a153-4d6a-9bbc-ac1ef013b3d1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1318 microversion: 2.1 time: 0.154961 Feb 08 16:44:20.432448 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 223/441] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:20 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:21.449305 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-5eeac8f6-e328-478a-9dc8-b6be99ad1c6a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:21.450144 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-5eeac8f6-e328-478a-9dc8-b6be99ad1c6a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:21.456253 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5eeac8f6-e328-478a-9dc8-b6be99ad1c6a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:21.456787 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5eeac8f6-e328-478a-9dc8-b6be99ad1c6a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:21.457693 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5eeac8f6-e328-478a-9dc8-b6be99ad1c6a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:21.458118 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5eeac8f6-e328-478a-9dc8-b6be99ad1c6a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:21.597531 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-5eeac8f6-e328-478a-9dc8-b6be99ad1c6a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:21.605455 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-5eeac8f6-e328-478a-9dc8-b6be99ad1c6a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1318 microversion: 2.1 time: 0.160602 Feb 08 16:44:21.606024 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 219/442] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:21 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:44:22.623941 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-db85b5ee-add4-4eb7-9f04-f64d009c2671 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:22.624553 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-db85b5ee-add4-4eb7-9f04-f64d009c2671 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:22.630966 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-db85b5ee-add4-4eb7-9f04-f64d009c2671 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:22.631610 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-db85b5ee-add4-4eb7-9f04-f64d009c2671 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:22.632401 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-db85b5ee-add4-4eb7-9f04-f64d009c2671 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:22.632875 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-db85b5ee-add4-4eb7-9f04-f64d009c2671 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:22.782892 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-db85b5ee-add4-4eb7-9f04-f64d009c2671 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:22.791005 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-db85b5ee-add4-4eb7-9f04-f64d009c2671 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1318 microversion: 2.1 time: 0.171707 Feb 08 16:44:22.791648 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 224/443] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:22 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:23.501650 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-9d00f699-b737-4236-bffa-8b29bfe9f784 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:23.502195 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-9d00f699-b737-4236-bffa-8b29bfe9f784 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:23.508651 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9d00f699-b737-4236-bffa-8b29bfe9f784 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:23.509103 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9d00f699-b737-4236-bffa-8b29bfe9f784 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:23.509908 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9d00f699-b737-4236-bffa-8b29bfe9f784 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:23.510342 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9d00f699-b737-4236-bffa-8b29bfe9f784 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:23.658793 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-9d00f699-b737-4236-bffa-8b29bfe9f784 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:23.666340 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-9d00f699-b737-4236-bffa-8b29bfe9f784 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1514 microversion: 2.1 time: 0.168253 Feb 08 16:44:23.666904 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 220/444] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:23 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:23.682230 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-4149f40c-ba42-4170-a190-08178d86dd7a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4aa3c55-b78d-4f45-82ff-746f46e6f3fc"}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:44:23.683894 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-4149f40c-ba42-4170-a190-08178d86dd7a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:23.689814 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4149f40c-ba42-4170-a190-08178d86dd7a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:23.690266 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4149f40c-ba42-4170-a190-08178d86dd7a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:23.691042 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4149f40c-ba42-4170-a190-08178d86dd7a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:23.691476 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4149f40c-ba42-4170-a190-08178d86dd7a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:23.808601 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-4b843200-7827-468c-b025-1903befcba5c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:23.809321 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4b843200-7827-468c-b025-1903befcba5c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:23.815837 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4b843200-7827-468c-b025-1903befcba5c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:23.816474 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4b843200-7827-468c-b025-1903befcba5c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:23.817267 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4b843200-7827-468c-b025-1903befcba5c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:23.817742 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4b843200-7827-468c-b025-1903befcba5c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:23.960976 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4b843200-7827-468c-b025-1903befcba5c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:23.961381 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-4149f40c-ba42-4170-a190-08178d86dd7a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "POST /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282892 Feb 08 16:44:23.963812 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 225/445] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Feb 8 16:44:23 2022] POST /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:44:23.970191 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-4b843200-7827-468c-b025-1903befcba5c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1508 microversion: 2.1 time: 0.165578 Feb 08 16:44:23.971583 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 221/446] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:23 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:44:23.991905 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-89474e4c-978f-42af-bb61-11fa6bdd663a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9647ca6-0f49-4aa1-a05a-cd076800708d"}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:44:23.994034 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-89474e4c-978f-42af-bb61-11fa6bdd663a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:24.015966 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-89474e4c-978f-42af-bb61-11fa6bdd663a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:24.016426 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-89474e4c-978f-42af-bb61-11fa6bdd663a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:24.017254 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-89474e4c-978f-42af-bb61-11fa6bdd663a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:24.017698 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-89474e4c-978f-42af-bb61-11fa6bdd663a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:24.125058 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-89474e4c-978f-42af-bb61-11fa6bdd663a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] HTTP exception thrown: Invalid volume: volume f9647ca6-0f49-4aa1-a05a-cd076800708d is already attached to instances: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed Feb 08 16:44:24.125870 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-89474e4c-978f-42af-bb61-11fa6bdd663a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Returning 400 to user: Invalid volume: volume f9647ca6-0f49-4aa1-a05a-cd076800708d is already attached to instances: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:44:24.126816 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-89474e4c-978f-42af-bb61-11fa6bdd663a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "POST /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.142155 Feb 08 16:44:24.127522 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 226/447] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Feb 8 16:44:23 2022] POST /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9/os-volume_attachments => generated 174 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 08 16:44:24.205226 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-81b14089-8484-4a3b-ba14-bfcf32e26962 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:24.206274 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-81b14089-8484-4a3b-ba14-bfcf32e26962 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:24.212327 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-81b14089-8484-4a3b-ba14-bfcf32e26962 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:24.212775 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-81b14089-8484-4a3b-ba14-bfcf32e26962 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:24.213568 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-81b14089-8484-4a3b-ba14-bfcf32e26962 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:24.214118 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-81b14089-8484-4a3b-ba14-bfcf32e26962 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:24.338880 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.objects.instance [None req-81b14089-8484-4a3b-ba14-bfcf32e26962 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lazy-loading 'services' on Instance uuid 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed {{(pid=122901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:44:24.449417 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-81b14089-8484-4a3b-ba14-bfcf32e26962 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "DELETE /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed/os-volume_attachments/f9647ca6-0f49-4aa1-a05a-cd076800708d" status: 202 len: 0 microversion: 2.1 time: 0.247197 Feb 08 16:44:24.450320 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 222/448] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Feb 8 16:44:24 2022] DELETE /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed/os-volume_attachments/f9647ca6-0f49-4aa1-a05a-cd076800708d => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:44:24.458507 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-f8160250-ac76-4876-9c20-5ecfe3b86da3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:24.459352 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-f8160250-ac76-4876-9c20-5ecfe3b86da3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:24.466489 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f8160250-ac76-4876-9c20-5ecfe3b86da3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:24.466984 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f8160250-ac76-4876-9c20-5ecfe3b86da3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:24.467811 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f8160250-ac76-4876-9c20-5ecfe3b86da3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:24.468295 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f8160250-ac76-4876-9c20-5ecfe3b86da3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:24.498726 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-f8160250-ac76-4876-9c20-5ecfe3b86da3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044066 Feb 08 16:44:24.499287 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 227/449] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:44:24 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:44:25.511768 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-c41e49c3-423b-4271-afd0-9b75d980bc67 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:25.512716 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-c41e49c3-423b-4271-afd0-9b75d980bc67 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:25.519213 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c41e49c3-423b-4271-afd0-9b75d980bc67 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:25.519661 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c41e49c3-423b-4271-afd0-9b75d980bc67 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:25.520465 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c41e49c3-423b-4271-afd0-9b75d980bc67 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:25.520901 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c41e49c3-423b-4271-afd0-9b75d980bc67 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:25.551427 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-c41e49c3-423b-4271-afd0-9b75d980bc67 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044309 Feb 08 16:44:25.552030 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 223/450] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:44:25 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:44:26.563246 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b942da0e-8d3e-4802-b701-5d9cf78ec725 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:26.564178 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b942da0e-8d3e-4802-b701-5d9cf78ec725 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:26.570429 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b942da0e-8d3e-4802-b701-5d9cf78ec725 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:26.570952 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b942da0e-8d3e-4802-b701-5d9cf78ec725 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:26.571733 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b942da0e-8d3e-4802-b701-5d9cf78ec725 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:26.572203 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b942da0e-8d3e-4802-b701-5d9cf78ec725 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:26.603776 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b942da0e-8d3e-4802-b701-5d9cf78ec725 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044203 Feb 08 16:44:26.604352 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 228/451] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:44:26 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:44:27.615406 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-4ca8b635-c8fa-4bbc-94ee-0e953d7d9681 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:27.616485 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4ca8b635-c8fa-4bbc-94ee-0e953d7d9681 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:27.624075 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4ca8b635-c8fa-4bbc-94ee-0e953d7d9681 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:27.624669 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4ca8b635-c8fa-4bbc-94ee-0e953d7d9681 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:27.625667 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4ca8b635-c8fa-4bbc-94ee-0e953d7d9681 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:27.626152 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4ca8b635-c8fa-4bbc-94ee-0e953d7d9681 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:27.656885 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-4ca8b635-c8fa-4bbc-94ee-0e953d7d9681 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045229 Feb 08 16:44:27.657551 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 224/452] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:44:27 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:44:28.668718 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-d6d541b1-beb6-482f-87ee-4bab62f4fae8 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:28.670052 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-d6d541b1-beb6-482f-87ee-4bab62f4fae8 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:28.676578 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d6d541b1-beb6-482f-87ee-4bab62f4fae8 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:28.677034 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d6d541b1-beb6-482f-87ee-4bab62f4fae8 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:28.677833 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d6d541b1-beb6-482f-87ee-4bab62f4fae8 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:28.678271 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d6d541b1-beb6-482f-87ee-4bab62f4fae8 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:28.707305 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-d6d541b1-beb6-482f-87ee-4bab62f4fae8 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043103 Feb 08 16:44:28.707875 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 229/453] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:44:28 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:44:29.719623 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-f850ad9c-59af-4385-8bc6-2cd67c8d7284 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:29.720548 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-f850ad9c-59af-4385-8bc6-2cd67c8d7284 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:29.726833 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f850ad9c-59af-4385-8bc6-2cd67c8d7284 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:29.727272 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f850ad9c-59af-4385-8bc6-2cd67c8d7284 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:29.728062 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f850ad9c-59af-4385-8bc6-2cd67c8d7284 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:29.728493 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f850ad9c-59af-4385-8bc6-2cd67c8d7284 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:29.758504 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-f850ad9c-59af-4385-8bc6-2cd67c8d7284 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042869 Feb 08 16:44:29.759050 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 225/454] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:44:29 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:44:30.770706 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-19e904bc-81e6-47a9-ad06-060cecae497f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:30.771614 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-19e904bc-81e6-47a9-ad06-060cecae497f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:30.778143 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-19e904bc-81e6-47a9-ad06-060cecae497f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:30.778588 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-19e904bc-81e6-47a9-ad06-060cecae497f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:30.779625 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-19e904bc-81e6-47a9-ad06-060cecae497f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:30.780083 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-19e904bc-81e6-47a9-ad06-060cecae497f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:30.818730 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-19e904bc-81e6-47a9-ad06-060cecae497f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052066 Feb 08 16:44:30.819297 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 230/455] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:44:30 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:44:31.834146 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-f6726d25-65e3-4696-89bb-464ee83f2641 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:31.835457 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-f6726d25-65e3-4696-89bb-464ee83f2641 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:31.843892 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f6726d25-65e3-4696-89bb-464ee83f2641 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:31.844348 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f6726d25-65e3-4696-89bb-464ee83f2641 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:31.845135 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f6726d25-65e3-4696-89bb-464ee83f2641 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:31.845569 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f6726d25-65e3-4696-89bb-464ee83f2641 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:31.875259 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-f6726d25-65e3-4696-89bb-464ee83f2641 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045846 Feb 08 16:44:31.875900 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 226/456] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:44:31 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:44:32.546760 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-0ef13ce6-ac02-4efd-ac11-36ea6d598e81 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:44:32.547677 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-0ef13ce6-ac02-4efd-ac11-36ea6d598e81 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:32.554044 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0ef13ce6-ac02-4efd-ac11-36ea6d598e81 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:32.554501 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0ef13ce6-ac02-4efd-ac11-36ea6d598e81 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:32.555287 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0ef13ce6-ac02-4efd-ac11-36ea6d598e81 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:32.555727 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0ef13ce6-ac02-4efd-ac11-36ea6d598e81 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:32.588835 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.objects.instance [None req-0ef13ce6-ac02-4efd-ac11-36ea6d598e81 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lazy-loading 'flavor' on Instance uuid 46b82748-ebae-4771-b414-3feb285df38d {{(pid=122902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:44:32.720757 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-0ef13ce6-ac02-4efd-ac11-36ea6d598e81 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "POST /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d/action" status: 200 len: 32 microversion: 2.1 time: 0.178047 Feb 08 16:44:32.721359 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 231/457] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Feb 8 16:44:32 2022] POST /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 08 16:44:32.730204 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-bca81977-85dc-4cfc-8372-316fe2051db5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:32.730999 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-bca81977-85dc-4cfc-8372-316fe2051db5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:32.737134 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bca81977-85dc-4cfc-8372-316fe2051db5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:32.737585 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bca81977-85dc-4cfc-8372-316fe2051db5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:32.738375 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bca81977-85dc-4cfc-8372-316fe2051db5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:32.738808 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bca81977-85dc-4cfc-8372-316fe2051db5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:32.881797 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-bca81977-85dc-4cfc-8372-316fe2051db5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:32.887495 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-3c90d164-203e-4cb4-b489-2a515c66e2e8 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:32.888808 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-3c90d164-203e-4cb4-b489-2a515c66e2e8 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:32.890826 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-bca81977-85dc-4cfc-8372-316fe2051db5 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1566 microversion: 2.1 time: 0.164330 Feb 08 16:44:32.891591 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 227/458] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:32 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:32.895622 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3c90d164-203e-4cb4-b489-2a515c66e2e8 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:32.895622 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3c90d164-203e-4cb4-b489-2a515c66e2e8 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:32.897424 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3c90d164-203e-4cb4-b489-2a515c66e2e8 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:32.897540 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3c90d164-203e-4cb4-b489-2a515c66e2e8 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:32.928540 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-3c90d164-203e-4cb4-b489-2a515c66e2e8 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045530 Feb 08 16:44:32.928969 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 232/459] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:44:32 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 08 16:44:33.120814 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-2652d4e3-3de2-4b8d-be27-97ae88080bc1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-364755130", "imageRef": "d70d3911-14f2-4cba-9283-bf4bef4fb526", "flavorRef": "452", "networks": [{"uuid": "ec8f7fac-5fb6-486d-81c6-a643c1dc738e"}]}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:44:33.907887 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-45a6197f-5098-4044-99e6-ee8a7e762dcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:33.908489 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-45a6197f-5098-4044-99e6-ee8a7e762dcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:33.914707 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-45a6197f-5098-4044-99e6-ee8a7e762dcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:33.915151 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-45a6197f-5098-4044-99e6-ee8a7e762dcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:33.915950 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-45a6197f-5098-4044-99e6-ee8a7e762dcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:33.916386 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-45a6197f-5098-4044-99e6-ee8a7e762dcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:34.056325 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-45a6197f-5098-4044-99e6-ee8a7e762dcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:34.066309 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-45a6197f-5098-4044-99e6-ee8a7e762dcd tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1566 microversion: 2.1 time: 0.161796 Feb 08 16:44:34.066843 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 233/460] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:33 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:44:35.083793 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-89a61bee-6144-43d9-9104-3789f2c1b480 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:35.084519 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-89a61bee-6144-43d9-9104-3789f2c1b480 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:35.091964 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-89a61bee-6144-43d9-9104-3789f2c1b480 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:35.092423 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-89a61bee-6144-43d9-9104-3789f2c1b480 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:35.093205 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-89a61bee-6144-43d9-9104-3789f2c1b480 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:35.093646 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-89a61bee-6144-43d9-9104-3789f2c1b480 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:35.225994 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-89a61bee-6144-43d9-9104-3789f2c1b480 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:35.233706 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-89a61bee-6144-43d9-9104-3789f2c1b480 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1566 microversion: 2.1 time: 0.153709 Feb 08 16:44:35.234312 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 234/461] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:35 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:44:36.250610 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-5e1163fe-5bca-42f1-9a5e-81d8bd43e934 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:36.251348 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-5e1163fe-5bca-42f1-9a5e-81d8bd43e934 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:36.258574 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5e1163fe-5bca-42f1-9a5e-81d8bd43e934 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:36.259087 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5e1163fe-5bca-42f1-9a5e-81d8bd43e934 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:36.259934 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5e1163fe-5bca-42f1-9a5e-81d8bd43e934 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:36.260533 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5e1163fe-5bca-42f1-9a5e-81d8bd43e934 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:36.387464 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.network.neutron [None req-2652d4e3-3de2-4b8d-be27-97ae88080bc1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] validate_networks() for [('ec8f7fac-5fb6-486d-81c6-a643c1dc738e', None, None, None, None, None)] {{(pid=122901) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 16:44:36.409574 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-5e1163fe-5bca-42f1-9a5e-81d8bd43e934 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:36.417570 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-5e1163fe-5bca-42f1-9a5e-81d8bd43e934 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1566 microversion: 2.1 time: 0.170815 Feb 08 16:44:36.427877 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 235/462] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:36 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:44:36.745918 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-2652d4e3-3de2-4b8d-be27-97ae88080bc1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Flavor limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 16:44:36.746345 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-2652d4e3-3de2-4b8d-be27-97ae88080bc1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Image limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 16:44:36.746826 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-2652d4e3-3de2-4b8d-be27-97ae88080bc1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Flavor pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 16:44:36.747234 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-2652d4e3-3de2-4b8d-be27-97ae88080bc1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Image pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 16:44:36.747646 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-2652d4e3-3de2-4b8d-be27-97ae88080bc1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 16:44:36.756853 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2652d4e3-3de2-4b8d-be27-97ae88080bc1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:36.757329 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2652d4e3-3de2-4b8d-be27-97ae88080bc1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:36.758201 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2652d4e3-3de2-4b8d-be27-97ae88080bc1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:36.758658 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2652d4e3-3de2-4b8d-be27-97ae88080bc1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:36.775415 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-2652d4e3-3de2-4b8d-be27-97ae88080bc1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Getting quotas for project 3b57fcb90a594af1b70daaecbf9efd96. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:44:36.780014 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-2652d4e3-3de2-4b8d-be27-97ae88080bc1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Getting quotas for user a5eff85a200a4a599e0cefe8d681d72d and project 3b57fcb90a594af1b70daaecbf9efd96. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:44:36.790532 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-2652d4e3-3de2-4b8d-be27-97ae88080bc1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Going to run 1 instances... {{(pid=122901) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 16:44:36.792873 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-2652d4e3-3de2-4b8d-be27-97ae88080bc1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d70d3911-14f2-4cba-9283-bf4bef4fb526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122901) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 16:44:36.836579 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-2652d4e3-3de2-4b8d-be27-97ae88080bc1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.721449 Feb 08 16:44:36.837218 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 228/463] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Feb 8 16:44:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 16:44:36.847543 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-62d2b3fb-b7c3-4f5f-8a7f-216dde9e22f3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:36.848362 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-62d2b3fb-b7c3-4f5f-8a7f-216dde9e22f3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:36.899742 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-62d2b3fb-b7c3-4f5f-8a7f-216dde9e22f3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:36.906984 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-62d2b3fb-b7c3-4f5f-8a7f-216dde9e22f3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1217 microversion: 2.1 time: 0.063328 Feb 08 16:44:36.907557 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 236/464] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:36 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1217 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:37.436665 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-8b519f1b-2fc7-4863-9dfa-79483c1705d0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:37.437278 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-8b519f1b-2fc7-4863-9dfa-79483c1705d0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:37.443243 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8b519f1b-2fc7-4863-9dfa-79483c1705d0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:37.443699 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8b519f1b-2fc7-4863-9dfa-79483c1705d0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:37.444511 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8b519f1b-2fc7-4863-9dfa-79483c1705d0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:37.444951 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8b519f1b-2fc7-4863-9dfa-79483c1705d0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:37.576491 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-8b519f1b-2fc7-4863-9dfa-79483c1705d0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:37.584218 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-8b519f1b-2fc7-4863-9dfa-79483c1705d0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1566 microversion: 2.1 time: 0.152655 Feb 08 16:44:37.584782 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 229/465] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:37 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:37.923595 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-a0e2f2ac-ab3d-456f-9148-68f4f42377e1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:37.924240 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-a0e2f2ac-ab3d-456f-9148-68f4f42377e1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:37.930490 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a0e2f2ac-ab3d-456f-9148-68f4f42377e1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:37.930946 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a0e2f2ac-ab3d-456f-9148-68f4f42377e1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:37.931726 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a0e2f2ac-ab3d-456f-9148-68f4f42377e1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:37.932200 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a0e2f2ac-ab3d-456f-9148-68f4f42377e1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:37.991480 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-a0e2f2ac-ab3d-456f-9148-68f4f42377e1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:37.998717 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-a0e2f2ac-ab3d-456f-9148-68f4f42377e1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1221 microversion: 2.1 time: 0.078856 Feb 08 16:44:37.999295 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 237/466] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:37 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1221 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:38.600372 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-8b258b54-1dbf-496c-82a8-259995531d3a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:38.600987 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-8b258b54-1dbf-496c-82a8-259995531d3a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:38.607338 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8b258b54-1dbf-496c-82a8-259995531d3a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:38.607833 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8b258b54-1dbf-496c-82a8-259995531d3a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:38.608617 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8b258b54-1dbf-496c-82a8-259995531d3a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:38.609056 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8b258b54-1dbf-496c-82a8-259995531d3a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:38.741323 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-8b258b54-1dbf-496c-82a8-259995531d3a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:38.749585 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-8b258b54-1dbf-496c-82a8-259995531d3a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1566 microversion: 2.1 time: 0.152839 Feb 08 16:44:38.750153 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 230/467] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:38 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:39.014408 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-64d0b539-5b01-4147-8a7b-123019fcec72 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:39.015010 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-64d0b539-5b01-4147-8a7b-123019fcec72 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:39.021471 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-64d0b539-5b01-4147-8a7b-123019fcec72 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:39.021928 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-64d0b539-5b01-4147-8a7b-123019fcec72 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:39.022748 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-64d0b539-5b01-4147-8a7b-123019fcec72 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:39.023190 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-64d0b539-5b01-4147-8a7b-123019fcec72 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:39.082479 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-64d0b539-5b01-4147-8a7b-123019fcec72 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:39.089575 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-64d0b539-5b01-4147-8a7b-123019fcec72 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1221 microversion: 2.1 time: 0.078823 Feb 08 16:44:39.090153 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 238/468] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:39 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1221 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:39.767519 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-27a6a4c4-37d0-4356-b518-cde1d415a08a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:39.768153 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-27a6a4c4-37d0-4356-b518-cde1d415a08a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:39.774404 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-27a6a4c4-37d0-4356-b518-cde1d415a08a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:39.774851 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-27a6a4c4-37d0-4356-b518-cde1d415a08a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:39.775623 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-27a6a4c4-37d0-4356-b518-cde1d415a08a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:39.776081 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-27a6a4c4-37d0-4356-b518-cde1d415a08a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:39.909667 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-27a6a4c4-37d0-4356-b518-cde1d415a08a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:39.917533 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-27a6a4c4-37d0-4356-b518-cde1d415a08a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1566 microversion: 2.1 time: 0.153514 Feb 08 16:44:39.918939 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 231/469] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:39 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:40.105873 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-febc1e79-3b3a-4d41-8b22-1b443e206527 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:40.106695 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-febc1e79-3b3a-4d41-8b22-1b443e206527 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:40.112988 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-febc1e79-3b3a-4d41-8b22-1b443e206527 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:40.113443 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-febc1e79-3b3a-4d41-8b22-1b443e206527 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:40.114214 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-febc1e79-3b3a-4d41-8b22-1b443e206527 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:40.114652 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-febc1e79-3b3a-4d41-8b22-1b443e206527 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:40.173111 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-febc1e79-3b3a-4d41-8b22-1b443e206527 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:40.180256 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-febc1e79-3b3a-4d41-8b22-1b443e206527 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1221 microversion: 2.1 time: 0.078210 Feb 08 16:44:40.180825 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 239/470] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:40 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1221 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:40.933946 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e81a0f23-1c9a-4fe3-a2a6-5b23fcf1bef1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:40.934583 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e81a0f23-1c9a-4fe3-a2a6-5b23fcf1bef1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:40.940829 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e81a0f23-1c9a-4fe3-a2a6-5b23fcf1bef1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:40.941271 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e81a0f23-1c9a-4fe3-a2a6-5b23fcf1bef1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:40.942039 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e81a0f23-1c9a-4fe3-a2a6-5b23fcf1bef1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:40.942467 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e81a0f23-1c9a-4fe3-a2a6-5b23fcf1bef1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:41.073999 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e81a0f23-1c9a-4fe3-a2a6-5b23fcf1bef1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:41.082313 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e81a0f23-1c9a-4fe3-a2a6-5b23fcf1bef1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1566 microversion: 2.1 time: 0.151997 Feb 08 16:44:41.082877 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 232/471] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:40 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:41.196958 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-fc231b4d-9262-4736-8752-2179d410b505 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:41.197561 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-fc231b4d-9262-4736-8752-2179d410b505 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:41.204393 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fc231b4d-9262-4736-8752-2179d410b505 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:41.204837 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fc231b4d-9262-4736-8752-2179d410b505 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:41.205615 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fc231b4d-9262-4736-8752-2179d410b505 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:41.206049 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fc231b4d-9262-4736-8752-2179d410b505 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:41.264627 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-fc231b4d-9262-4736-8752-2179d410b505 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:41.271821 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-fc231b4d-9262-4736-8752-2179d410b505 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1221 microversion: 2.1 time: 0.078421 Feb 08 16:44:41.272434 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 240/472] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:41 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1221 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:42.099380 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-683e6455-275d-41de-a481-a72750f16aa0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:42.100044 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-683e6455-275d-41de-a481-a72750f16aa0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:42.106957 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-683e6455-275d-41de-a481-a72750f16aa0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:42.107401 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-683e6455-275d-41de-a481-a72750f16aa0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:42.108194 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-683e6455-275d-41de-a481-a72750f16aa0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:42.108625 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-683e6455-275d-41de-a481-a72750f16aa0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:42.246801 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-683e6455-275d-41de-a481-a72750f16aa0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:42.257731 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-683e6455-275d-41de-a481-a72750f16aa0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1566 microversion: 2.1 time: 0.161611 Feb 08 16:44:42.258959 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 233/473] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:42 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:42.288580 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-5fc72a5d-6347-43c3-b147-bf13f834cb82 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:42.289179 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-5fc72a5d-6347-43c3-b147-bf13f834cb82 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:42.296171 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5fc72a5d-6347-43c3-b147-bf13f834cb82 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:42.296618 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5fc72a5d-6347-43c3-b147-bf13f834cb82 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:42.297390 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5fc72a5d-6347-43c3-b147-bf13f834cb82 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:42.297821 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5fc72a5d-6347-43c3-b147-bf13f834cb82 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:42.368743 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-5fc72a5d-6347-43c3-b147-bf13f834cb82 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:42.376951 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-5fc72a5d-6347-43c3-b147-bf13f834cb82 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1269 microversion: 2.1 time: 0.091875 Feb 08 16:44:42.377614 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 241/474] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:42 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1269 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:43.275635 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-1cca088c-4728-437a-b8f9-c5789c8bc09a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:43.276371 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-1cca088c-4728-437a-b8f9-c5789c8bc09a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:43.282687 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1cca088c-4728-437a-b8f9-c5789c8bc09a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:43.283130 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1cca088c-4728-437a-b8f9-c5789c8bc09a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:43.283926 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1cca088c-4728-437a-b8f9-c5789c8bc09a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:43.284355 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1cca088c-4728-437a-b8f9-c5789c8bc09a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:43.394138 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-1a17566e-1f78-41b9-af1f-4152de22b6c1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:43.395480 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-1a17566e-1f78-41b9-af1f-4152de22b6c1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:43.403173 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1a17566e-1f78-41b9-af1f-4152de22b6c1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:43.403999 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1a17566e-1f78-41b9-af1f-4152de22b6c1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:43.405013 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1a17566e-1f78-41b9-af1f-4152de22b6c1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:43.405648 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1a17566e-1f78-41b9-af1f-4152de22b6c1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:43.426024 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-1cca088c-4728-437a-b8f9-c5789c8bc09a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:43.434668 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-1cca088c-4728-437a-b8f9-c5789c8bc09a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1566 microversion: 2.1 time: 0.162525 Feb 08 16:44:43.435300 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 234/475] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:43 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:43.499204 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-1a17566e-1f78-41b9-af1f-4152de22b6c1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:43.506772 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-1a17566e-1f78-41b9-af1f-4152de22b6c1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1275 microversion: 2.1 time: 0.116262 Feb 08 16:44:43.516637 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 242/476] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:43 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1275 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:44.372762 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-18a10187-a3b3-4db6-8dc6-5ed4c4a6aefe req-ee8647d9-a815-4e05-b240-6f1b8ac50f1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2d6f884-29c3-4149-9eaf-7432f6f92a89", "tag": "9b9c193c-1cd8-48cc-8cbf-37ead2d5bc3d"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:44:44.374908 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:44:44.374908 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:44:44.383372 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-18a10187-a3b3-4db6-8dc6-5ed4c4a6aefe req-ee8647d9-a815-4e05-b240-6f1b8ac50f1b service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:44.384190 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-18a10187-a3b3-4db6-8dc6-5ed4c4a6aefe req-ee8647d9-a815-4e05-b240-6f1b8ac50f1b service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:44.396870 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-18a10187-a3b3-4db6-8dc6-5ed4c4a6aefe req-ee8647d9-a815-4e05-b240-6f1b8ac50f1b service nova] Creating event network-changed:9b9c193c-1cd8-48cc-8cbf-37ead2d5bc3d for instance f2d6f884-29c3-4149-9eaf-7432f6f92a89 on hv-cinder-82786 Feb 08 16:44:44.403231 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-18a10187-a3b3-4db6-8dc6-5ed4c4a6aefe req-ee8647d9-a815-4e05-b240-6f1b8ac50f1b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039659 Feb 08 16:44:44.404355 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 235/477] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:44:44.452810 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-cabbdd77-53a9-4d3c-97ba-14f5dddee6bc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:44.454131 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-cabbdd77-53a9-4d3c-97ba-14f5dddee6bc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:44.460824 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cabbdd77-53a9-4d3c-97ba-14f5dddee6bc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:44.461450 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cabbdd77-53a9-4d3c-97ba-14f5dddee6bc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:44.462341 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cabbdd77-53a9-4d3c-97ba-14f5dddee6bc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:44.462786 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cabbdd77-53a9-4d3c-97ba-14f5dddee6bc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:44.525185 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-5a2015df-2205-468b-9208-282943cb0521 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:44.526242 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-5a2015df-2205-468b-9208-282943cb0521 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:44.537419 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5a2015df-2205-468b-9208-282943cb0521 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:44.538096 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5a2015df-2205-468b-9208-282943cb0521 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:44.540861 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5a2015df-2205-468b-9208-282943cb0521 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:44.541346 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5a2015df-2205-468b-9208-282943cb0521 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:44.796330 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-5a2015df-2205-468b-9208-282943cb0521 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:44.806296 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-5a2015df-2205-468b-9208-282943cb0521 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1317 microversion: 2.1 time: 0.285821 Feb 08 16:44:44.807145 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 236/478] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:44 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:44:44.958171 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-cabbdd77-53a9-4d3c-97ba-14f5dddee6bc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:44.968384 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-cabbdd77-53a9-4d3c-97ba-14f5dddee6bc tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1566 microversion: 2.1 time: 0.520436 Feb 08 16:44:44.969489 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 243/479] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:44 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1566 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:45.823699 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-732e8967-3868-422d-ad53-bd0f0ae7550e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:45.824934 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-732e8967-3868-422d-ad53-bd0f0ae7550e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:45.831515 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-732e8967-3868-422d-ad53-bd0f0ae7550e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:45.832009 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-732e8967-3868-422d-ad53-bd0f0ae7550e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:45.832792 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-732e8967-3868-422d-ad53-bd0f0ae7550e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:45.833227 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-732e8967-3868-422d-ad53-bd0f0ae7550e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:45.962883 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-732e8967-3868-422d-ad53-bd0f0ae7550e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:45.970264 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-732e8967-3868-422d-ad53-bd0f0ae7550e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1317 microversion: 2.1 time: 0.150472 Feb 08 16:44:45.970826 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 237/480] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:45 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:44:45.985498 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-db4d8d3d-943d-4de4-b846-ba764e7366ad tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:45.986113 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-db4d8d3d-943d-4de4-b846-ba764e7366ad tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:45.992414 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-db4d8d3d-943d-4de4-b846-ba764e7366ad tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:45.992871 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-db4d8d3d-943d-4de4-b846-ba764e7366ad tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:45.993662 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-db4d8d3d-943d-4de4-b846-ba764e7366ad tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:45.994106 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-db4d8d3d-943d-4de4-b846-ba764e7366ad tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:46.130028 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-db4d8d3d-943d-4de4-b846-ba764e7366ad tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:46.138787 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-db4d8d3d-943d-4de4-b846-ba764e7366ad tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1566 microversion: 2.1 time: 0.156924 Feb 08 16:44:46.139358 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 244/481] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:45 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:46.986216 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-f021bd20-9ba0-4c65-a846-d378d7f0a09c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:46.986752 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-f021bd20-9ba0-4c65-a846-d378d7f0a09c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:46.994233 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f021bd20-9ba0-4c65-a846-d378d7f0a09c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:46.995681 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f021bd20-9ba0-4c65-a846-d378d7f0a09c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:46.996843 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f021bd20-9ba0-4c65-a846-d378d7f0a09c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:46.997486 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f021bd20-9ba0-4c65-a846-d378d7f0a09c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:47.137958 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f021bd20-9ba0-4c65-a846-d378d7f0a09c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:47.145154 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-f021bd20-9ba0-4c65-a846-d378d7f0a09c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1317 microversion: 2.1 time: 0.162674 Feb 08 16:44:47.145720 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 238/482] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:46 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:47.155833 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-94adf190-609f-4b75-9632-eb4475f325e9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:47.156472 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-94adf190-609f-4b75-9632-eb4475f325e9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:47.162705 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-94adf190-609f-4b75-9632-eb4475f325e9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:47.163157 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-94adf190-609f-4b75-9632-eb4475f325e9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:47.163968 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-94adf190-609f-4b75-9632-eb4475f325e9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:47.164411 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-94adf190-609f-4b75-9632-eb4475f325e9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:47.294776 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-94adf190-609f-4b75-9632-eb4475f325e9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:47.303110 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-94adf190-609f-4b75-9632-eb4475f325e9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1566 microversion: 2.1 time: 0.151554 Feb 08 16:44:47.303684 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 245/483] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:47 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:48.162197 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-0e06ff79-e269-434c-a378-7e9154e1c872 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:48.162888 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-0e06ff79-e269-434c-a378-7e9154e1c872 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:48.170012 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0e06ff79-e269-434c-a378-7e9154e1c872 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:48.170462 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0e06ff79-e269-434c-a378-7e9154e1c872 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:48.171267 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0e06ff79-e269-434c-a378-7e9154e1c872 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:48.171811 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0e06ff79-e269-434c-a378-7e9154e1c872 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:48.315237 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0e06ff79-e269-434c-a378-7e9154e1c872 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:48.320094 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b3a03192-7ffa-4d22-b8ab-5d1d142c0b3a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:48.320798 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b3a03192-7ffa-4d22-b8ab-5d1d142c0b3a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:48.322884 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-0e06ff79-e269-434c-a378-7e9154e1c872 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1317 microversion: 2.1 time: 0.164331 Feb 08 16:44:48.323456 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 239/484] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:48 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:48.327392 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b3a03192-7ffa-4d22-b8ab-5d1d142c0b3a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:48.327884 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b3a03192-7ffa-4d22-b8ab-5d1d142c0b3a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:48.328675 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b3a03192-7ffa-4d22-b8ab-5d1d142c0b3a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:48.329122 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b3a03192-7ffa-4d22-b8ab-5d1d142c0b3a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:48.464526 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b3a03192-7ffa-4d22-b8ab-5d1d142c0b3a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:48.472872 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b3a03192-7ffa-4d22-b8ab-5d1d142c0b3a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1566 microversion: 2.1 time: 0.156336 Feb 08 16:44:48.473431 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 246/485] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:48 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:44:49.338895 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-8c879e86-561f-4edb-b371-5c68e41a7765 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:49.339525 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-8c879e86-561f-4edb-b371-5c68e41a7765 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:49.346630 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8c879e86-561f-4edb-b371-5c68e41a7765 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:49.347086 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8c879e86-561f-4edb-b371-5c68e41a7765 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:49.347902 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8c879e86-561f-4edb-b371-5c68e41a7765 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:49.348339 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8c879e86-561f-4edb-b371-5c68e41a7765 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:49.489483 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-8c879e86-561f-4edb-b371-5c68e41a7765 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:49.490179 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-0f9342ae-85b2-4cc4-b464-f2ec94218e1c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:49.490830 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-0f9342ae-85b2-4cc4-b464-f2ec94218e1c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:49.496850 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-8c879e86-561f-4edb-b371-5c68e41a7765 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1317 microversion: 2.1 time: 0.161394 Feb 08 16:44:49.496998 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0f9342ae-85b2-4cc4-b464-f2ec94218e1c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:49.497423 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 240/486] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:49 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:49.498244 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0f9342ae-85b2-4cc4-b464-f2ec94218e1c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:49.498460 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0f9342ae-85b2-4cc4-b464-f2ec94218e1c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:49.498899 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0f9342ae-85b2-4cc4-b464-f2ec94218e1c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:49.633595 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-0f9342ae-85b2-4cc4-b464-f2ec94218e1c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:49.641817 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-0f9342ae-85b2-4cc4-b464-f2ec94218e1c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1566 microversion: 2.1 time: 0.155243 Feb 08 16:44:49.642376 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 247/487] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:49 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:44:50.514860 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-f2f4fed8-a6cd-45b3-8194-ddd4620d63e4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:50.515516 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-f2f4fed8-a6cd-45b3-8194-ddd4620d63e4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:50.521810 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f2f4fed8-a6cd-45b3-8194-ddd4620d63e4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:50.522252 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f2f4fed8-a6cd-45b3-8194-ddd4620d63e4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:50.523016 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f2f4fed8-a6cd-45b3-8194-ddd4620d63e4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:50.523448 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f2f4fed8-a6cd-45b3-8194-ddd4620d63e4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:50.658115 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f2f4fed8-a6cd-45b3-8194-ddd4620d63e4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:50.660407 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-4390d1a6-e4a1-4957-bdeb-270d9ed9225f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:50.661044 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-4390d1a6-e4a1-4957-bdeb-270d9ed9225f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:50.665610 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-f2f4fed8-a6cd-45b3-8194-ddd4620d63e4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1317 microversion: 2.1 time: 0.155315 Feb 08 16:44:50.666258 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 241/488] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:50 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:50.667401 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4390d1a6-e4a1-4957-bdeb-270d9ed9225f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:50.667904 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4390d1a6-e4a1-4957-bdeb-270d9ed9225f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:50.668700 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4390d1a6-e4a1-4957-bdeb-270d9ed9225f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:50.669145 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4390d1a6-e4a1-4957-bdeb-270d9ed9225f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:50.804975 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-4390d1a6-e4a1-4957-bdeb-270d9ed9225f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:50.812758 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-4390d1a6-e4a1-4957-bdeb-270d9ed9225f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1566 microversion: 2.1 time: 0.155961 Feb 08 16:44:50.813320 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 248/489] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:50 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:44:51.682416 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-c805376d-adbc-45df-8163-b9c8c0a67fa1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:51.683158 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-c805376d-adbc-45df-8163-b9c8c0a67fa1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:51.690292 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c805376d-adbc-45df-8163-b9c8c0a67fa1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:51.690821 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c805376d-adbc-45df-8163-b9c8c0a67fa1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:51.691619 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c805376d-adbc-45df-8163-b9c8c0a67fa1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:51.692090 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c805376d-adbc-45df-8163-b9c8c0a67fa1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:51.823567 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c805376d-adbc-45df-8163-b9c8c0a67fa1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:51.828794 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-751b1eb1-d5fc-4508-b126-7e146111d8c2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:51.829408 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-751b1eb1-d5fc-4508-b126-7e146111d8c2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:51.831431 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-c805376d-adbc-45df-8163-b9c8c0a67fa1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1317 microversion: 2.1 time: 0.152642 Feb 08 16:44:51.832057 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 242/490] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:51 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:51.835943 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-751b1eb1-d5fc-4508-b126-7e146111d8c2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:51.836397 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-751b1eb1-d5fc-4508-b126-7e146111d8c2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:51.837180 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-751b1eb1-d5fc-4508-b126-7e146111d8c2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:51.837621 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-751b1eb1-d5fc-4508-b126-7e146111d8c2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:51.976471 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-751b1eb1-d5fc-4508-b126-7e146111d8c2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:51.984917 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-751b1eb1-d5fc-4508-b126-7e146111d8c2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1566 microversion: 2.1 time: 0.159934 Feb 08 16:44:51.985345 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 249/491] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:51 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:44:52.849493 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-c229e29f-8d4c-422d-b5b5-4ac18b497260 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:52.850165 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-c229e29f-8d4c-422d-b5b5-4ac18b497260 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:52.856571 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c229e29f-8d4c-422d-b5b5-4ac18b497260 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:52.857119 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c229e29f-8d4c-422d-b5b5-4ac18b497260 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:52.858914 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c229e29f-8d4c-422d-b5b5-4ac18b497260 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:52.860207 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c229e29f-8d4c-422d-b5b5-4ac18b497260 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:53.005313 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-f4601bef-0798-4935-8547-d271c9bbfd7c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:53.006438 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-f4601bef-0798-4935-8547-d271c9bbfd7c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:53.012899 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f4601bef-0798-4935-8547-d271c9bbfd7c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:53.014169 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f4601bef-0798-4935-8547-d271c9bbfd7c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:53.015051 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f4601bef-0798-4935-8547-d271c9bbfd7c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:53.015495 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f4601bef-0798-4935-8547-d271c9bbfd7c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:53.022928 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c229e29f-8d4c-422d-b5b5-4ac18b497260 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:53.032365 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-c229e29f-8d4c-422d-b5b5-4ac18b497260 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1317 microversion: 2.1 time: 0.187608 Feb 08 16:44:53.034642 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 243/492] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:52 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:53.179500 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-f4601bef-0798-4935-8547-d271c9bbfd7c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:53.190136 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-f4601bef-0798-4935-8547-d271c9bbfd7c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1566 microversion: 2.1 time: 0.192272 Feb 08 16:44:53.190740 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 250/493] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:52 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1566 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:54.050944 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-9f13f942-4d93-41f1-bd4a-90161d0b2283 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:54.051389 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-9f13f942-4d93-41f1-bd4a-90161d0b2283 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:54.057899 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9f13f942-4d93-41f1-bd4a-90161d0b2283 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:54.058373 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9f13f942-4d93-41f1-bd4a-90161d0b2283 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:54.059158 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9f13f942-4d93-41f1-bd4a-90161d0b2283 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:54.059592 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9f13f942-4d93-41f1-bd4a-90161d0b2283 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:54.196844 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-9f13f942-4d93-41f1-bd4a-90161d0b2283 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:54.204868 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-9f13f942-4d93-41f1-bd4a-90161d0b2283 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1317 microversion: 2.1 time: 0.157763 Feb 08 16:44:54.205437 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 244/494] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:54 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:54.208058 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-73913b12-7fe4-47aa-a87d-496ebd5c7c18 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:54.208838 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-73913b12-7fe4-47aa-a87d-496ebd5c7c18 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:54.214584 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-73913b12-7fe4-47aa-a87d-496ebd5c7c18 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:54.215036 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-73913b12-7fe4-47aa-a87d-496ebd5c7c18 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:54.215835 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-73913b12-7fe4-47aa-a87d-496ebd5c7c18 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:54.216452 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-73913b12-7fe4-47aa-a87d-496ebd5c7c18 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:54.346059 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-73913b12-7fe4-47aa-a87d-496ebd5c7c18 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:54.354110 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-73913b12-7fe4-47aa-a87d-496ebd5c7c18 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1566 microversion: 2.1 time: 0.149941 Feb 08 16:44:54.354704 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 251/495] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:54 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:44:55.222172 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e4730d1b-f0ef-48b2-9532-04c9928f6713 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:55.222781 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e4730d1b-f0ef-48b2-9532-04c9928f6713 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:55.229014 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e4730d1b-f0ef-48b2-9532-04c9928f6713 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:55.229458 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e4730d1b-f0ef-48b2-9532-04c9928f6713 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:55.230229 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e4730d1b-f0ef-48b2-9532-04c9928f6713 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:55.230661 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e4730d1b-f0ef-48b2-9532-04c9928f6713 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:55.364840 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e4730d1b-f0ef-48b2-9532-04c9928f6713 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:55.370064 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-5fcbd79e-d29b-485d-97a2-ffaf7c24bb69 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:55.370675 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-5fcbd79e-d29b-485d-97a2-ffaf7c24bb69 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:55.373354 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e4730d1b-f0ef-48b2-9532-04c9928f6713 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1317 microversion: 2.1 time: 0.154659 Feb 08 16:44:55.373935 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 245/496] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:55 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:55.377048 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5fcbd79e-d29b-485d-97a2-ffaf7c24bb69 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:55.377501 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5fcbd79e-d29b-485d-97a2-ffaf7c24bb69 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:55.378285 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5fcbd79e-d29b-485d-97a2-ffaf7c24bb69 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:55.378723 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5fcbd79e-d29b-485d-97a2-ffaf7c24bb69 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:55.516404 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-5fcbd79e-d29b-485d-97a2-ffaf7c24bb69 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:55.524077 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-5fcbd79e-d29b-485d-97a2-ffaf7c24bb69 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1546 microversion: 2.1 time: 0.157645 Feb 08 16:44:55.524636 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 252/497] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:55 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:44:55.540203 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ee7017da-7d50-47a6-a225-c2a396831ea4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:55.540700 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-ee7017da-7d50-47a6-a225-c2a396831ea4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:55.547087 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ee7017da-7d50-47a6-a225-c2a396831ea4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:55.547538 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ee7017da-7d50-47a6-a225-c2a396831ea4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:55.548350 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ee7017da-7d50-47a6-a225-c2a396831ea4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:55.548791 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ee7017da-7d50-47a6-a225-c2a396831ea4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:55.626747 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.wsgi [None req-ee7017da-7d50-47a6-a225-c2a396831ea4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] HTTP exception thrown: Cannot 'detach_volume' instance 46b82748-ebae-4771-b414-3feb285df38d while it is in vm_state rescued Feb 08 16:44:55.627348 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ee7017da-7d50-47a6-a225-c2a396831ea4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Returning 409 to user: Cannot 'detach_volume' instance 46b82748-ebae-4771-b414-3feb285df38d while it is in vm_state rescued {{(pid=122901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:44:55.628217 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-ee7017da-7d50-47a6-a225-c2a396831ea4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "DELETE /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d/os-volume_attachments/d4aa3c55-b78d-4f45-82ff-746f46e6f3fc" status: 409 len: 152 microversion: 2.1 time: 0.091897 Feb 08 16:44:55.629033 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 246/498] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Feb 8 16:44:55 2022] DELETE /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d/os-volume_attachments/d4aa3c55-b78d-4f45-82ff-746f46e6f3fc => generated 152 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 08 16:44:55.637071 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-84f7119c-68b1-43f9-924f-bd682db91d17 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:44:55.637610 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-84f7119c-68b1-43f9-924f-bd682db91d17 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:55.643588 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-84f7119c-68b1-43f9-924f-bd682db91d17 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:55.644166 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-84f7119c-68b1-43f9-924f-bd682db91d17 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:55.645069 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-84f7119c-68b1-43f9-924f-bd682db91d17 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:55.645636 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-84f7119c-68b1-43f9-924f-bd682db91d17 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:55.720670 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-84f7119c-68b1-43f9-924f-bd682db91d17 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "POST /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d/action" status: 202 len: 0 microversion: 2.1 time: 0.087007 Feb 08 16:44:55.721466 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 253/499] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Feb 8 16:44:55 2022] POST /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:44:55.729715 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-9092a7f4-1fe8-4a80-8824-a64ad1aac854 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:55.730320 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-9092a7f4-1fe8-4a80-8824-a64ad1aac854 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:55.736989 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9092a7f4-1fe8-4a80-8824-a64ad1aac854 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:55.737751 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9092a7f4-1fe8-4a80-8824-a64ad1aac854 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:55.738992 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9092a7f4-1fe8-4a80-8824-a64ad1aac854 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:55.739613 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9092a7f4-1fe8-4a80-8824-a64ad1aac854 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:55.879778 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-9092a7f4-1fe8-4a80-8824-a64ad1aac854 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:55.887533 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-9092a7f4-1fe8-4a80-8824-a64ad1aac854 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1554 microversion: 2.1 time: 0.161977 Feb 08 16:44:55.888408 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 247/500] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:55 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:56.354987 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-435f9e06-7c57-42a6-b6b1-3f0158f5ee2a req-68e4075b-3002-4e33-841f-5070df108309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2d6f884-29c3-4149-9eaf-7432f6f92a89", "name": "network-vif-plugged", "status": "completed", "tag": "9b9c193c-1cd8-48cc-8cbf-37ead2d5bc3d"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:44:56.356654 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:44:56.356654 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:44:56.365156 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-435f9e06-7c57-42a6-b6b1-3f0158f5ee2a req-68e4075b-3002-4e33-841f-5070df108309 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:56.365617 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-435f9e06-7c57-42a6-b6b1-3f0158f5ee2a req-68e4075b-3002-4e33-841f-5070df108309 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:56.377851 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-435f9e06-7c57-42a6-b6b1-3f0158f5ee2a req-68e4075b-3002-4e33-841f-5070df108309 service nova] Creating event network-vif-plugged:9b9c193c-1cd8-48cc-8cbf-37ead2d5bc3d for instance f2d6f884-29c3-4149-9eaf-7432f6f92a89 on hv-cinder-82786 Feb 08 16:44:56.382744 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-435f9e06-7c57-42a6-b6b1-3f0158f5ee2a req-68e4075b-3002-4e33-841f-5070df108309 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031820 Feb 08 16:44:56.383532 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 254/501] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:44:56.390707 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-dd254642-cfe7-498c-aa19-f27c0e826a4a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:56.392107 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-dd254642-cfe7-498c-aa19-f27c0e826a4a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:56.398463 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dd254642-cfe7-498c-aa19-f27c0e826a4a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:56.398926 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dd254642-cfe7-498c-aa19-f27c0e826a4a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:56.399709 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dd254642-cfe7-498c-aa19-f27c0e826a4a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:56.400177 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dd254642-cfe7-498c-aa19-f27c0e826a4a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:56.551538 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-dd254642-cfe7-498c-aa19-f27c0e826a4a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:56.559188 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-dd254642-cfe7-498c-aa19-f27c0e826a4a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1317 microversion: 2.1 time: 0.173038 Feb 08 16:44:56.560551 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 248/502] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:56 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:56.905397 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-3b5e8446-3cf3-4201-84a2-abc46303980c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:56.905914 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-3b5e8446-3cf3-4201-84a2-abc46303980c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:56.912311 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3b5e8446-3cf3-4201-84a2-abc46303980c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:56.912769 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3b5e8446-3cf3-4201-84a2-abc46303980c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:56.913558 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3b5e8446-3cf3-4201-84a2-abc46303980c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:56.914205 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3b5e8446-3cf3-4201-84a2-abc46303980c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:57.048450 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3b5e8446-3cf3-4201-84a2-abc46303980c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:57.057202 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-3b5e8446-3cf3-4201-84a2-abc46303980c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1554 microversion: 2.1 time: 0.156207 Feb 08 16:44:57.057770 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 255/503] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:56 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:57.576184 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-93f60978-dc87-4a8e-a871-865c7a46b5df tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:57.576850 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-93f60978-dc87-4a8e-a871-865c7a46b5df tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:57.583016 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-93f60978-dc87-4a8e-a871-865c7a46b5df tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:57.583524 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-93f60978-dc87-4a8e-a871-865c7a46b5df tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:57.584290 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-93f60978-dc87-4a8e-a871-865c7a46b5df tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:57.584745 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-93f60978-dc87-4a8e-a871-865c7a46b5df tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:57.728276 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-93f60978-dc87-4a8e-a871-865c7a46b5df tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:57.736006 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-93f60978-dc87-4a8e-a871-865c7a46b5df tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1317 microversion: 2.1 time: 0.163445 Feb 08 16:44:57.736569 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 249/504] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:57 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:58.074987 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-4179fe8f-1ea8-4475-9bfb-61a9b5595eba tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:58.075601 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-4179fe8f-1ea8-4475-9bfb-61a9b5595eba tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:58.082959 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4179fe8f-1ea8-4475-9bfb-61a9b5595eba tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:58.083422 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4179fe8f-1ea8-4475-9bfb-61a9b5595eba tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:58.084244 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4179fe8f-1ea8-4475-9bfb-61a9b5595eba tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:58.084687 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4179fe8f-1ea8-4475-9bfb-61a9b5595eba tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:58.224741 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-4179fe8f-1ea8-4475-9bfb-61a9b5595eba tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:58.233490 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-4179fe8f-1ea8-4475-9bfb-61a9b5595eba tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1554 microversion: 2.1 time: 0.162153 Feb 08 16:44:58.234314 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 256/505] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:58 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:58.752990 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-7d5481ef-2e31-44f0-9282-a5c8419a3aff tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:58.753602 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7d5481ef-2e31-44f0-9282-a5c8419a3aff tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:58.760100 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7d5481ef-2e31-44f0-9282-a5c8419a3aff tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:58.760555 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7d5481ef-2e31-44f0-9282-a5c8419a3aff tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:58.761329 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7d5481ef-2e31-44f0-9282-a5c8419a3aff tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:58.761770 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7d5481ef-2e31-44f0-9282-a5c8419a3aff tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:58.896000 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7d5481ef-2e31-44f0-9282-a5c8419a3aff tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:58.903182 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-7d5481ef-2e31-44f0-9282-a5c8419a3aff tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1317 microversion: 2.1 time: 0.154597 Feb 08 16:44:58.903776 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 250/506] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:58 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:59.250494 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-0f227a11-413a-412b-b6c7-74a259be9fd9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:59.251092 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-0f227a11-413a-412b-b6c7-74a259be9fd9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:59.257808 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0f227a11-413a-412b-b6c7-74a259be9fd9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:59.258254 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0f227a11-413a-412b-b6c7-74a259be9fd9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:59.259017 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0f227a11-413a-412b-b6c7-74a259be9fd9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:59.259447 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0f227a11-413a-412b-b6c7-74a259be9fd9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:59.395299 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-0f227a11-413a-412b-b6c7-74a259be9fd9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:44:59.402995 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-0f227a11-413a-412b-b6c7-74a259be9fd9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1554 microversion: 2.1 time: 0.156151 Feb 08 16:44:59.403553 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 257/507] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:59 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:44:59.919677 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-9703e725-a3e6-4201-b008-e920d11de88e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:44:59.920372 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-9703e725-a3e6-4201-b008-e920d11de88e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:44:59.926717 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9703e725-a3e6-4201-b008-e920d11de88e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:59.927169 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9703e725-a3e6-4201-b008-e920d11de88e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:44:59.927985 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9703e725-a3e6-4201-b008-e920d11de88e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:44:59.928428 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9703e725-a3e6-4201-b008-e920d11de88e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:00.063580 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-9703e725-a3e6-4201-b008-e920d11de88e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:00.071870 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-9703e725-a3e6-4201-b008-e920d11de88e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1507 microversion: 2.1 time: 0.156029 Feb 08 16:45:00.072448 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 251/508] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:44:59 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:00.420597 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-aa308597-3179-4cf4-b962-db961ed82ad0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:00.421360 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-aa308597-3179-4cf4-b962-db961ed82ad0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:00.429337 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-aa308597-3179-4cf4-b962-db961ed82ad0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:00.429797 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-aa308597-3179-4cf4-b962-db961ed82ad0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:00.430720 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-aa308597-3179-4cf4-b962-db961ed82ad0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:00.431167 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-aa308597-3179-4cf4-b962-db961ed82ad0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:00.567973 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-aa308597-3179-4cf4-b962-db961ed82ad0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:00.575770 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-aa308597-3179-4cf4-b962-db961ed82ad0 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1554 microversion: 2.1 time: 0.159050 Feb 08 16:45:00.576331 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 258/509] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:00 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:01.592636 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b88afdfb-8080-4f67-8438-c61ec214160f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:01.593177 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-b88afdfb-8080-4f67-8438-c61ec214160f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:01.600239 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b88afdfb-8080-4f67-8438-c61ec214160f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:01.600685 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b88afdfb-8080-4f67-8438-c61ec214160f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:01.601486 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b88afdfb-8080-4f67-8438-c61ec214160f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:01.601919 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b88afdfb-8080-4f67-8438-c61ec214160f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:01.734620 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-b88afdfb-8080-4f67-8438-c61ec214160f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:01.742485 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-b88afdfb-8080-4f67-8438-c61ec214160f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1560 microversion: 2.1 time: 0.153543 Feb 08 16:45:01.743050 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 252/510] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:01 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:01.809807 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-1edebcfb-1a88-4a25-959e-25e2bc570eca tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:01.810302 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-1edebcfb-1a88-4a25-959e-25e2bc570eca tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:01.817033 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1edebcfb-1a88-4a25-959e-25e2bc570eca tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:01.817511 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1edebcfb-1a88-4a25-959e-25e2bc570eca tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:01.818494 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1edebcfb-1a88-4a25-959e-25e2bc570eca tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:01.818827 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1edebcfb-1a88-4a25-959e-25e2bc570eca tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:01.942426 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.objects.instance [None req-1edebcfb-1a88-4a25-959e-25e2bc570eca tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lazy-loading 'services' on Instance uuid 46b82748-ebae-4771-b414-3feb285df38d {{(pid=122902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:45:02.052380 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-1edebcfb-1a88-4a25-959e-25e2bc570eca tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "DELETE /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d/os-volume_attachments/d4aa3c55-b78d-4f45-82ff-746f46e6f3fc" status: 202 len: 0 microversion: 2.1 time: 0.246045 Feb 08 16:45:02.052966 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 259/511] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Feb 8 16:45:01 2022] DELETE /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d/os-volume_attachments/d4aa3c55-b78d-4f45-82ff-746f46e6f3fc => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:45:02.061390 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e494df19-e4bb-4f46-a98e-e76a3577659d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:02.062360 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e494df19-e4bb-4f46-a98e-e76a3577659d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:02.069296 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e494df19-e4bb-4f46-a98e-e76a3577659d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:02.069752 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e494df19-e4bb-4f46-a98e-e76a3577659d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:02.070545 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e494df19-e4bb-4f46-a98e-e76a3577659d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:02.070979 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e494df19-e4bb-4f46-a98e-e76a3577659d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:02.102637 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e494df19-e4bb-4f46-a98e-e76a3577659d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045006 Feb 08 16:45:02.103199 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 253/512] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:45:02 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:45:02.332099 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 16:45:02.332279 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: Tue Feb 8 16:45:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 16:45:02.436485 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-468f468a-cecb-4f24-b4c7-f0da58c8c0bc tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79d05231-de30-44ea-9c10-69c95bfb93de"}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:45:02.437680 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-468f468a-cecb-4f24-b4c7-f0da58c8c0bc tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:02.444565 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-468f468a-cecb-4f24-b4c7-f0da58c8c0bc tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:02.445009 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-468f468a-cecb-4f24-b4c7-f0da58c8c0bc tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:02.445789 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-468f468a-cecb-4f24-b4c7-f0da58c8c0bc tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:02.446226 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-468f468a-cecb-4f24-b4c7-f0da58c8c0bc tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:02.713296 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-468f468a-cecb-4f24-b4c7-f0da58c8c0bc tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "POST /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281221 Feb 08 16:45:02.713986 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 260/513] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Feb 8 16:45:02 2022] POST /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:45:02.845228 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-4b6339f9-b19c-4e54-8393-065c29fbe7c5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1596669893", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-887258110", "security_groups": [{"name": "tempest-secgroup-smoke-51338702"}], "networks": [{"uuid": "c554db4f-82e2-45eb-abb6-e85a666ce499"}], "block_device_mapping_v2": [{"uuid": "db5d2230-6e39-457b-bae3-fdeaf9f72f5d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:45:02.964819 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.network.neutron [None req-4b6339f9-b19c-4e54-8393-065c29fbe7c5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] validate_networks() for [('c554db4f-82e2-45eb-abb6-e85a666ce499', None, None, None, None, None)] {{(pid=122901) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 16:45:03.114999 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b36fd476-c15b-4036-95cb-b9d0a6c4330d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:03.116191 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b36fd476-c15b-4036-95cb-b9d0a6c4330d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:03.122781 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b36fd476-c15b-4036-95cb-b9d0a6c4330d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:03.123235 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b36fd476-c15b-4036-95cb-b9d0a6c4330d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:03.124062 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b36fd476-c15b-4036-95cb-b9d0a6c4330d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:03.124504 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b36fd476-c15b-4036-95cb-b9d0a6c4330d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:03.156286 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b36fd476-c15b-4036-95cb-b9d0a6c4330d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045803 Feb 08 16:45:03.156874 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 261/514] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:45:03 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:45:03.562123 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-4b6339f9-b19c-4e54-8393-065c29fbe7c5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Flavor limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 16:45:03.562550 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-4b6339f9-b19c-4e54-8393-065c29fbe7c5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Image limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 16:45:03.563021 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-4b6339f9-b19c-4e54-8393-065c29fbe7c5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Flavor pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 16:45:03.564020 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-4b6339f9-b19c-4e54-8393-065c29fbe7c5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Image pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 16:45:03.564443 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-4b6339f9-b19c-4e54-8393-065c29fbe7c5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 16:45:03.574339 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4b6339f9-b19c-4e54-8393-065c29fbe7c5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:03.574898 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4b6339f9-b19c-4e54-8393-065c29fbe7c5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:03.575816 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4b6339f9-b19c-4e54-8393-065c29fbe7c5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:03.576345 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4b6339f9-b19c-4e54-8393-065c29fbe7c5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:03.596777 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-4b6339f9-b19c-4e54-8393-065c29fbe7c5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Getting quotas for project 08bc94fd80244144ae5883c54707e219. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:45:03.602654 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-4b6339f9-b19c-4e54-8393-065c29fbe7c5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Getting quotas for user 89bb4f5ad936444093f3115c65c441b1 and project 08bc94fd80244144ae5883c54707e219. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:45:03.660384 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4b6339f9-b19c-4e54-8393-065c29fbe7c5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Going to run 1 instances... {{(pid=122901) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 16:45:03.662528 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4b6339f9-b19c-4e54-8393-065c29fbe7c5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='db5d2230-6e39-457b-bae3-fdeaf9f72f5d',volume_size=None,volume_type=None)] {{(pid=122901) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 16:45:03.786935 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-4b6339f9-b19c-4e54-8393-065c29fbe7c5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.945294 Feb 08 16:45:03.787745 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 254/515] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Feb 8 16:45:02 2022] POST /compute/v2.1/servers => generated 404 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 16:45:03.798291 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-663fb721-3e6a-4ade-848f-3c0f373e01d7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:03.799202 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-663fb721-3e6a-4ade-848f-3c0f373e01d7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:03.856642 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-663fb721-3e6a-4ade-848f-3c0f373e01d7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:03.864966 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-663fb721-3e6a-4ade-848f-3c0f373e01d7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1088 microversion: 2.1 time: 0.071121 Feb 08 16:45:03.871925 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 262/516] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:03 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1088 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:04.168706 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-5a8e7d82-0f0b-416f-8c0b-6410d3ee07da tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:04.169693 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-5a8e7d82-0f0b-416f-8c0b-6410d3ee07da tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:04.176714 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5a8e7d82-0f0b-416f-8c0b-6410d3ee07da tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:04.177240 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5a8e7d82-0f0b-416f-8c0b-6410d3ee07da tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:04.178041 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5a8e7d82-0f0b-416f-8c0b-6410d3ee07da tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:04.178483 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5a8e7d82-0f0b-416f-8c0b-6410d3ee07da tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:04.208177 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-5a8e7d82-0f0b-416f-8c0b-6410d3ee07da tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043630 Feb 08 16:45:04.208735 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 255/517] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:45:04 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 08 16:45:04.891574 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-fe42eed9-9022-432b-a90f-278f1e511204 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:04.892112 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-fe42eed9-9022-432b-a90f-278f1e511204 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:04.899945 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fe42eed9-9022-432b-a90f-278f1e511204 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:04.900405 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fe42eed9-9022-432b-a90f-278f1e511204 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:04.901186 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fe42eed9-9022-432b-a90f-278f1e511204 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:04.901851 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fe42eed9-9022-432b-a90f-278f1e511204 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:04.971239 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-fe42eed9-9022-432b-a90f-278f1e511204 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:04.978682 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-fe42eed9-9022-432b-a90f-278f1e511204 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1204 microversion: 2.1 time: 0.100580 Feb 08 16:45:04.979247 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 263/518] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:04 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1204 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:05.653008 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b8f4c605-36aa-4214-8d09-fd29c08f2cb4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f19c1472-510a-4cff-a1df-ecc7d17d20aa", "device": "/dev/sdb"}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:45:05.654658 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-b8f4c605-36aa-4214-8d09-fd29c08f2cb4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:05.661274 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b8f4c605-36aa-4214-8d09-fd29c08f2cb4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:05.661717 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b8f4c605-36aa-4214-8d09-fd29c08f2cb4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:05.662489 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b8f4c605-36aa-4214-8d09-fd29c08f2cb4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:05.662991 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b8f4c605-36aa-4214-8d09-fd29c08f2cb4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:05.912362 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-b8f4c605-36aa-4214-8d09-fd29c08f2cb4 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "POST /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263246 Feb 08 16:45:05.913438 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 256/519] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Feb 8 16:45:05 2022] POST /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:45:05.998709 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-5d32b562-fd11-424f-a5f2-6d8263e769a2 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:05.999552 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-5d32b562-fd11-424f-a5f2-6d8263e769a2 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:06.012237 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5d32b562-fd11-424f-a5f2-6d8263e769a2 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:06.012922 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5d32b562-fd11-424f-a5f2-6d8263e769a2 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:06.014003 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5d32b562-fd11-424f-a5f2-6d8263e769a2 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:06.014641 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5d32b562-fd11-424f-a5f2-6d8263e769a2 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:06.235648 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-5d32b562-fd11-424f-a5f2-6d8263e769a2 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:06.243437 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-5d32b562-fd11-424f-a5f2-6d8263e769a2 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1270 microversion: 2.1 time: 0.251541 Feb 08 16:45:06.243978 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 264/520] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:05 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1270 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:06.291920 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-918b77c4-bf3a-4681-a223-55bb5fcf577a req-6289421b-4ab1-4249-a14c-8d1161b2ef5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f5b0dab-9c28-4519-a6f6-c98d7c9a5287", "tag": "6f04fb2f-d81d-42f0-8c53-184ef0859a38"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:45:06.293522 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:45:06.293522 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:45:06.302553 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-918b77c4-bf3a-4681-a223-55bb5fcf577a req-6289421b-4ab1-4249-a14c-8d1161b2ef5e service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:06.303333 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-918b77c4-bf3a-4681-a223-55bb5fcf577a req-6289421b-4ab1-4249-a14c-8d1161b2ef5e service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:06.321615 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-918b77c4-bf3a-4681-a223-55bb5fcf577a req-6289421b-4ab1-4249-a14c-8d1161b2ef5e service nova] Creating event network-changed:6f04fb2f-d81d-42f0-8c53-184ef0859a38 for instance 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 on hv-cinder-82786 Feb 08 16:45:06.326965 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-918b77c4-bf3a-4681-a223-55bb5fcf577a req-6289421b-4ab1-4249-a14c-8d1161b2ef5e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043507 Feb 08 16:45:06.327647 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 257/521] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:45:07.260886 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-df0d220b-5d33-4223-882b-0db45e8ee265 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:07.261515 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-df0d220b-5d33-4223-882b-0db45e8ee265 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:07.268156 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-df0d220b-5d33-4223-882b-0db45e8ee265 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:07.268925 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-df0d220b-5d33-4223-882b-0db45e8ee265 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:07.270061 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-df0d220b-5d33-4223-882b-0db45e8ee265 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:07.270512 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-df0d220b-5d33-4223-882b-0db45e8ee265 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:07.404603 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-df0d220b-5d33-4223-882b-0db45e8ee265 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:07.412380 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-df0d220b-5d33-4223-882b-0db45e8ee265 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1270 microversion: 2.1 time: 0.155711 Feb 08 16:45:07.412955 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 265/522] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:07 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:07.582439 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-a9e486af-9ec8-401c-90e1-96be989ecd90 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:07.583014 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-a9e486af-9ec8-401c-90e1-96be989ecd90 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:07.589027 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a9e486af-9ec8-401c-90e1-96be989ecd90 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:07.589474 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a9e486af-9ec8-401c-90e1-96be989ecd90 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:07.590246 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a9e486af-9ec8-401c-90e1-96be989ecd90 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:07.590680 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a9e486af-9ec8-401c-90e1-96be989ecd90 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:07.616198 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-a9e486af-9ec8-401c-90e1-96be989ecd90 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Going to try to terminate instance {{(pid=122901) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 16:45:07.689965 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-a9e486af-9ec8-401c-90e1-96be989ecd90 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "DELETE /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 204 len: 0 microversion: 2.1 time: 0.112134 Feb 08 16:45:07.690560 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 258/523] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Feb 8 16:45:07 2022] DELETE /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 16:45:07.698483 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-5228db9e-84e2-4090-bc79-8dbd39bc1e0a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:07.699127 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-5228db9e-84e2-4090-bc79-8dbd39bc1e0a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:07.704976 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5228db9e-84e2-4090-bc79-8dbd39bc1e0a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:07.705425 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5228db9e-84e2-4090-bc79-8dbd39bc1e0a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:07.706230 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5228db9e-84e2-4090-bc79-8dbd39bc1e0a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:07.707251 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5228db9e-84e2-4090-bc79-8dbd39bc1e0a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:07.840015 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-5228db9e-84e2-4090-bc79-8dbd39bc1e0a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:07.847793 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-5228db9e-84e2-4090-bc79-8dbd39bc1e0a tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1507 microversion: 2.1 time: 0.152371 Feb 08 16:45:07.848382 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 266/524] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:07 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:08.429923 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-7e7536fe-41fe-49fe-9061-5002fd5b6e91 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:08.430619 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7e7536fe-41fe-49fe-9061-5002fd5b6e91 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:08.436841 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7e7536fe-41fe-49fe-9061-5002fd5b6e91 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:08.437287 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7e7536fe-41fe-49fe-9061-5002fd5b6e91 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:08.438063 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7e7536fe-41fe-49fe-9061-5002fd5b6e91 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:08.438500 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7e7536fe-41fe-49fe-9061-5002fd5b6e91 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:08.574153 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7e7536fe-41fe-49fe-9061-5002fd5b6e91 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:08.581497 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-7e7536fe-41fe-49fe-9061-5002fd5b6e91 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1270 microversion: 2.1 time: 0.156101 Feb 08 16:45:08.582289 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 259/525] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:08 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:08.864935 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-13be75a0-6046-4e80-9c23-21abb34df867 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:08.865572 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-13be75a0-6046-4e80-9c23-21abb34df867 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:08.871862 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-13be75a0-6046-4e80-9c23-21abb34df867 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:08.872305 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-13be75a0-6046-4e80-9c23-21abb34df867 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:08.873073 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-13be75a0-6046-4e80-9c23-21abb34df867 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:08.873504 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-13be75a0-6046-4e80-9c23-21abb34df867 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:09.007591 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-13be75a0-6046-4e80-9c23-21abb34df867 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:09.014790 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-13be75a0-6046-4e80-9c23-21abb34df867 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1507 microversion: 2.1 time: 0.154158 Feb 08 16:45:09.015384 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 267/526] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:08 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:09.598921 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-05c75315-b497-434a-a702-bf16bd9014b7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:09.599736 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-05c75315-b497-434a-a702-bf16bd9014b7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:09.605818 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-05c75315-b497-434a-a702-bf16bd9014b7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:09.606268 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-05c75315-b497-434a-a702-bf16bd9014b7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:09.607047 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-05c75315-b497-434a-a702-bf16bd9014b7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:09.607483 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-05c75315-b497-434a-a702-bf16bd9014b7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:09.742695 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-05c75315-b497-434a-a702-bf16bd9014b7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:09.749807 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-05c75315-b497-434a-a702-bf16bd9014b7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1270 microversion: 2.1 time: 0.155345 Feb 08 16:45:09.750368 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 260/527] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:09 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:10.031550 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-7f36c3a4-63a9-4d8c-935a-3c3d3b9382b2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:10.032181 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-7f36c3a4-63a9-4d8c-935a-3c3d3b9382b2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:10.038570 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7f36c3a4-63a9-4d8c-935a-3c3d3b9382b2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:10.039023 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7f36c3a4-63a9-4d8c-935a-3c3d3b9382b2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:10.039821 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7f36c3a4-63a9-4d8c-935a-3c3d3b9382b2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:10.040263 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7f36c3a4-63a9-4d8c-935a-3c3d3b9382b2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:10.180183 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-7f36c3a4-63a9-4d8c-935a-3c3d3b9382b2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:10.187025 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-7f36c3a4-63a9-4d8c-935a-3c3d3b9382b2 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1507 microversion: 2.1 time: 0.159096 Feb 08 16:45:10.187590 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 268/528] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:10 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:10.766377 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-14001529-408f-4f9d-b84a-1a6ae6b53fb7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:10.767205 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-14001529-408f-4f9d-b84a-1a6ae6b53fb7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:10.775565 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-14001529-408f-4f9d-b84a-1a6ae6b53fb7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:10.776041 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-14001529-408f-4f9d-b84a-1a6ae6b53fb7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:10.777537 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-14001529-408f-4f9d-b84a-1a6ae6b53fb7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:10.777997 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-14001529-408f-4f9d-b84a-1a6ae6b53fb7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:10.914887 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-14001529-408f-4f9d-b84a-1a6ae6b53fb7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:10.922963 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-14001529-408f-4f9d-b84a-1a6ae6b53fb7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1270 microversion: 2.1 time: 0.160073 Feb 08 16:45:10.923557 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 261/529] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:10 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:11.206262 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-d5036403-29b8-4e6d-87e9-47f805d5ca8f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:11.208223 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-d5036403-29b8-4e6d-87e9-47f805d5ca8f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:11.215512 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d5036403-29b8-4e6d-87e9-47f805d5ca8f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:11.216327 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d5036403-29b8-4e6d-87e9-47f805d5ca8f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:11.217831 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d5036403-29b8-4e6d-87e9-47f805d5ca8f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:11.218426 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d5036403-29b8-4e6d-87e9-47f805d5ca8f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:11.335427 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-a12e9630-8711-4261-8490-c186ec01ff6d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79d05231-de30-44ea-9c10-69c95bfb93de"}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:45:11.336623 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-a12e9630-8711-4261-8490-c186ec01ff6d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:11.342514 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a12e9630-8711-4261-8490-c186ec01ff6d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:11.343068 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a12e9630-8711-4261-8490-c186ec01ff6d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:11.343974 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a12e9630-8711-4261-8490-c186ec01ff6d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:11.344483 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a12e9630-8711-4261-8490-c186ec01ff6d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:11.365936 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-d5036403-29b8-4e6d-87e9-47f805d5ca8f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:11.373156 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-d5036403-29b8-4e6d-87e9-47f805d5ca8f tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1507 microversion: 2.1 time: 0.172969 Feb 08 16:45:11.373800 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 269/530] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:11 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:11.422987 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.wsgi [None req-a12e9630-8711-4261-8490-c186ec01ff6d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] HTTP exception thrown: Invalid volume: volume 79d05231-de30-44ea-9c10-69c95bfb93de is already attached to instances: f2d6f884-29c3-4149-9eaf-7432f6f92a89 Feb 08 16:45:11.423596 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-a12e9630-8711-4261-8490-c186ec01ff6d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Returning 400 to user: Invalid volume: volume 79d05231-de30-44ea-9c10-69c95bfb93de is already attached to instances: f2d6f884-29c3-4149-9eaf-7432f6f92a89 {{(pid=122901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:45:11.424483 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-a12e9630-8711-4261-8490-c186ec01ff6d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "POST /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093489 Feb 08 16:45:11.425037 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 262/531] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Feb 8 16:45:11 2022] POST /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 08 16:45:11.503418 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-2d4516c5-7045-4987-95b8-ba290eb0f720 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:11.504194 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-2d4516c5-7045-4987-95b8-ba290eb0f720 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:11.510767 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2d4516c5-7045-4987-95b8-ba290eb0f720 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:11.511217 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2d4516c5-7045-4987-95b8-ba290eb0f720 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:11.512019 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2d4516c5-7045-4987-95b8-ba290eb0f720 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:11.512458 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2d4516c5-7045-4987-95b8-ba290eb0f720 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:11.592761 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.objects.instance [None req-2d4516c5-7045-4987-95b8-ba290eb0f720 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lazy-loading 'services' on Instance uuid f2d6f884-29c3-4149-9eaf-7432f6f92a89 {{(pid=122902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:45:11.665899 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-2d4516c5-7045-4987-95b8-ba290eb0f720 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments/79d05231-de30-44ea-9c10-69c95bfb93de" status: 202 len: 0 microversion: 2.1 time: 0.165882 Feb 08 16:45:11.669867 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 270/532] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Feb 8 16:45:11 2022] DELETE /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments/79d05231-de30-44ea-9c10-69c95bfb93de => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:45:11.674662 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-47463484-5860-4200-adcb-eac7df7a8f02 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:11.675634 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-47463484-5860-4200-adcb-eac7df7a8f02 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:11.682271 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-47463484-5860-4200-adcb-eac7df7a8f02 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:11.682934 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-47463484-5860-4200-adcb-eac7df7a8f02 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:11.683851 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-47463484-5860-4200-adcb-eac7df7a8f02 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:11.684301 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-47463484-5860-4200-adcb-eac7df7a8f02 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:11.714469 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-47463484-5860-4200-adcb-eac7df7a8f02 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043474 Feb 08 16:45:11.715037 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 263/533] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:45:11 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:45:11.940421 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e554029a-52b4-4676-9db0-9421baecf145 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:11.941046 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e554029a-52b4-4676-9db0-9421baecf145 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:11.947563 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e554029a-52b4-4676-9db0-9421baecf145 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:11.948057 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e554029a-52b4-4676-9db0-9421baecf145 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:11.948862 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e554029a-52b4-4676-9db0-9421baecf145 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:11.949301 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e554029a-52b4-4676-9db0-9421baecf145 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:12.272476 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e554029a-52b4-4676-9db0-9421baecf145 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:12.279813 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e554029a-52b4-4676-9db0-9421baecf145 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.343521 Feb 08 16:45:12.290171 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 271/534] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:11 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:12.387556 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-a6c6562d-a1a7-4718-a96d-446128863d6d req-affdd8d4-563d-4624-86b0-d0b77a40b871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3491de9b-89ec-4861-b97f-f32158e658cc", "name": "network-vif-deleted", "tag": "34c8d083-5aff-4e0c-ab35-54f6088f7587"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:45:12.389082 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:45:12.389082 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:45:12.390120 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-565c906e-a7aa-4d73-93eb-9763fb042d38 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:12.390733 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-565c906e-a7aa-4d73-93eb-9763fb042d38 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:12.397625 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-a6c6562d-a1a7-4718-a96d-446128863d6d req-affdd8d4-563d-4624-86b0-d0b77a40b871 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:12.397854 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-565c906e-a7aa-4d73-93eb-9763fb042d38 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:12.398060 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-a6c6562d-a1a7-4718-a96d-446128863d6d req-affdd8d4-563d-4624-86b0-d0b77a40b871 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:12.398654 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-565c906e-a7aa-4d73-93eb-9763fb042d38 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:12.399667 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-565c906e-a7aa-4d73-93eb-9763fb042d38 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:12.400432 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-565c906e-a7aa-4d73-93eb-9763fb042d38 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:12.409267 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-a6c6562d-a1a7-4718-a96d-446128863d6d req-affdd8d4-563d-4624-86b0-d0b77a40b871 service nova] Creating event network-vif-deleted:34c8d083-5aff-4e0c-ab35-54f6088f7587 for instance 3491de9b-89ec-4861-b97f-f32158e658cc on hv-cinder-82786 Feb 08 16:45:12.415098 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-a6c6562d-a1a7-4718-a96d-446128863d6d req-affdd8d4-563d-4624-86b0-d0b77a40b871 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030802 Feb 08 16:45:12.415824 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 264/535] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:45:12.465241 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-565c906e-a7aa-4d73-93eb-9763fb042d38 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:12.472935 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-565c906e-a7aa-4d73-93eb-9763fb042d38 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 200 len: 1465 microversion: 2.1 time: 0.086406 Feb 08 16:45:12.474658 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 272/536] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:12 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 1465 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:45:12.726619 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-9c3f5fef-225b-4a57-ac7d-2c02fd83fdc2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:12.727639 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-9c3f5fef-225b-4a57-ac7d-2c02fd83fdc2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:12.733854 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9c3f5fef-225b-4a57-ac7d-2c02fd83fdc2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:12.734355 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9c3f5fef-225b-4a57-ac7d-2c02fd83fdc2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:12.735173 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9c3f5fef-225b-4a57-ac7d-2c02fd83fdc2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:12.735643 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9c3f5fef-225b-4a57-ac7d-2c02fd83fdc2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:12.764898 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-9c3f5fef-225b-4a57-ac7d-2c02fd83fdc2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043064 Feb 08 16:45:12.765449 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 265/537] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:45:12 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:45:13.297442 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-264dd66f-5c49-43b1-b421-7855476b072a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:13.298055 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-264dd66f-5c49-43b1-b421-7855476b072a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:13.304528 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-264dd66f-5c49-43b1-b421-7855476b072a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:13.304986 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-264dd66f-5c49-43b1-b421-7855476b072a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:13.305769 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-264dd66f-5c49-43b1-b421-7855476b072a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:13.306210 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-264dd66f-5c49-43b1-b421-7855476b072a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:13.439545 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-264dd66f-5c49-43b1-b421-7855476b072a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:13.447454 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-264dd66f-5c49-43b1-b421-7855476b072a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.153710 Feb 08 16:45:13.448062 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 273/538] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:13 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:13.492557 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-f1b2671b-db10-420f-8d5c-d7dd149052cb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:13.493200 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-f1b2671b-db10-420f-8d5c-d7dd149052cb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 3491de9b-89ec-4861-b97f-f32158e658cc] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:13.499456 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f1b2671b-db10-420f-8d5c-d7dd149052cb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:13.499952 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f1b2671b-db10-420f-8d5c-d7dd149052cb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:13.500738 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f1b2671b-db10-420f-8d5c-d7dd149052cb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:13.501177 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f1b2671b-db10-420f-8d5c-d7dd149052cb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:13.516817 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.wsgi [None req-f1b2671b-db10-420f-8d5c-d7dd149052cb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] HTTP exception thrown: Instance 3491de9b-89ec-4861-b97f-f32158e658cc could not be found. Feb 08 16:45:13.517415 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-f1b2671b-db10-420f-8d5c-d7dd149052cb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Returning 404 to user: Instance 3491de9b-89ec-4861-b97f-f32158e658cc could not be found. {{(pid=122901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:45:13.518238 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-f1b2671b-db10-420f-8d5c-d7dd149052cb tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc" status: 404 len: 111 microversion: 2.1 time: 0.030255 Feb 08 16:45:13.518776 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 266/539] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:13 2022] GET /compute/v2.1/servers/3491de9b-89ec-4861-b97f-f32158e658cc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:45:13.526596 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c56e44d2-5027-42be-b558-6aa3639d9b33 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:13.527198 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c56e44d2-5027-42be-b558-6aa3639d9b33 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:13.533235 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c56e44d2-5027-42be-b558-6aa3639d9b33 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:13.533836 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c56e44d2-5027-42be-b558-6aa3639d9b33 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:13.534707 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c56e44d2-5027-42be-b558-6aa3639d9b33 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:13.535217 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c56e44d2-5027-42be-b558-6aa3639d9b33 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:13.559917 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c56e44d2-5027-42be-b558-6aa3639d9b33 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Going to try to terminate instance {{(pid=122902) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 16:45:13.634467 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c56e44d2-5027-42be-b558-6aa3639d9b33 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "DELETE /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 204 len: 0 microversion: 2.1 time: 0.111091 Feb 08 16:45:13.635095 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 274/540] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Feb 8 16:45:13 2022] DELETE /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 16:45:13.642836 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-dbc58bad-84eb-47e0-b210-cdb26c2e61b6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:13.643444 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-dbc58bad-84eb-47e0-b210-cdb26c2e61b6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:13.649521 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dbc58bad-84eb-47e0-b210-cdb26c2e61b6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:13.650008 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dbc58bad-84eb-47e0-b210-cdb26c2e61b6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:13.650922 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dbc58bad-84eb-47e0-b210-cdb26c2e61b6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:13.651366 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dbc58bad-84eb-47e0-b210-cdb26c2e61b6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:13.776972 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-ea0e4faa-9b37-445f-a5cc-d2d237b1df9d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:13.778053 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-ea0e4faa-9b37-445f-a5cc-d2d237b1df9d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:13.783960 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ea0e4faa-9b37-445f-a5cc-d2d237b1df9d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:13.784415 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ea0e4faa-9b37-445f-a5cc-d2d237b1df9d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:13.785302 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ea0e4faa-9b37-445f-a5cc-d2d237b1df9d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:13.785810 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ea0e4faa-9b37-445f-a5cc-d2d237b1df9d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:13.787874 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-dbc58bad-84eb-47e0-b210-cdb26c2e61b6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:13.795258 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-dbc58bad-84eb-47e0-b210-cdb26c2e61b6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.156151 Feb 08 16:45:13.799798 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 267/541] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:13 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:13.815848 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-ea0e4faa-9b37-445f-a5cc-d2d237b1df9d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042851 Feb 08 16:45:13.816350 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 275/542] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:45:13 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:45:14.463658 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-890cfb51-fde7-4514-8ebb-30dcb142fbca tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:14.464303 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-890cfb51-fde7-4514-8ebb-30dcb142fbca tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:14.470142 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-890cfb51-fde7-4514-8ebb-30dcb142fbca tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:14.470595 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-890cfb51-fde7-4514-8ebb-30dcb142fbca tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:14.471375 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-890cfb51-fde7-4514-8ebb-30dcb142fbca tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:14.471843 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-890cfb51-fde7-4514-8ebb-30dcb142fbca tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:14.605960 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-890cfb51-fde7-4514-8ebb-30dcb142fbca tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:14.613163 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-890cfb51-fde7-4514-8ebb-30dcb142fbca tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.153073 Feb 08 16:45:14.613775 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 268/543] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:14 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:14.812408 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-9876799f-ccd1-4674-857a-692583ac8ede tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:14.813050 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-9876799f-ccd1-4674-857a-692583ac8ede tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:14.819907 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9876799f-ccd1-4674-857a-692583ac8ede tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:14.820363 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9876799f-ccd1-4674-857a-692583ac8ede tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:14.821144 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9876799f-ccd1-4674-857a-692583ac8ede tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:14.821580 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9876799f-ccd1-4674-857a-692583ac8ede tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:14.827352 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-6f7e25e8-20a4-4e93-a939-cc13fcc1028a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:14.828370 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-6f7e25e8-20a4-4e93-a939-cc13fcc1028a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:14.835231 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6f7e25e8-20a4-4e93-a939-cc13fcc1028a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:14.835679 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6f7e25e8-20a4-4e93-a939-cc13fcc1028a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:14.836489 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6f7e25e8-20a4-4e93-a939-cc13fcc1028a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:14.836922 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6f7e25e8-20a4-4e93-a939-cc13fcc1028a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:14.871945 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-6f7e25e8-20a4-4e93-a939-cc13fcc1028a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048054 Feb 08 16:45:14.872829 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 269/544] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:45:14 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:45:14.962335 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9876799f-ccd1-4674-857a-692583ac8ede tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:14.969854 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-9876799f-ccd1-4674-857a-692583ac8ede tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.161011 Feb 08 16:45:14.970878 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 276/545] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:14 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:15.628949 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e8db5e1f-f831-44df-a240-4842acb64ff7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:15.629660 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e8db5e1f-f831-44df-a240-4842acb64ff7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:15.636530 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e8db5e1f-f831-44df-a240-4842acb64ff7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:15.636981 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e8db5e1f-f831-44df-a240-4842acb64ff7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:15.637794 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e8db5e1f-f831-44df-a240-4842acb64ff7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:15.638229 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e8db5e1f-f831-44df-a240-4842acb64ff7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:15.774020 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e8db5e1f-f831-44df-a240-4842acb64ff7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:15.781176 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e8db5e1f-f831-44df-a240-4842acb64ff7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.156221 Feb 08 16:45:15.781739 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 270/546] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:15 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:15.883669 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-29a5309e-e340-49da-8988-bad326ee344a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:15.884594 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-29a5309e-e340-49da-8988-bad326ee344a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:15.890768 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-29a5309e-e340-49da-8988-bad326ee344a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:15.891217 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-29a5309e-e340-49da-8988-bad326ee344a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:15.892017 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-29a5309e-e340-49da-8988-bad326ee344a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:15.892452 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-29a5309e-e340-49da-8988-bad326ee344a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:15.922701 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-29a5309e-e340-49da-8988-bad326ee344a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043120 Feb 08 16:45:15.923253 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 277/547] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:45:15 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:45:15.985954 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d132e1ef-3203-4068-8e30-3df3cc4130f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:15.986558 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-d132e1ef-3203-4068-8e30-3df3cc4130f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:15.992480 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d132e1ef-3203-4068-8e30-3df3cc4130f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:15.992928 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d132e1ef-3203-4068-8e30-3df3cc4130f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:15.993703 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d132e1ef-3203-4068-8e30-3df3cc4130f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:15.994153 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d132e1ef-3203-4068-8e30-3df3cc4130f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:16.125681 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d132e1ef-3203-4068-8e30-3df3cc4130f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:16.133312 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d132e1ef-3203-4068-8e30-3df3cc4130f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.150918 Feb 08 16:45:16.133935 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 271/548] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:15 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:16.798417 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-0c7be9ce-f428-4fb0-90bf-ba87f3cb556d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:16.798962 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-0c7be9ce-f428-4fb0-90bf-ba87f3cb556d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:16.805212 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0c7be9ce-f428-4fb0-90bf-ba87f3cb556d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:16.805660 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0c7be9ce-f428-4fb0-90bf-ba87f3cb556d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:16.806435 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0c7be9ce-f428-4fb0-90bf-ba87f3cb556d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:16.806867 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0c7be9ce-f428-4fb0-90bf-ba87f3cb556d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:16.933972 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b712cc9b-227e-496a-a7e8-3d0dfd8b1869 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:16.934974 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-b712cc9b-227e-496a-a7e8-3d0dfd8b1869 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:16.939981 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-0c7be9ce-f428-4fb0-90bf-ba87f3cb556d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:16.942418 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b712cc9b-227e-496a-a7e8-3d0dfd8b1869 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:16.942997 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b712cc9b-227e-496a-a7e8-3d0dfd8b1869 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:16.943789 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b712cc9b-227e-496a-a7e8-3d0dfd8b1869 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:16.944219 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b712cc9b-227e-496a-a7e8-3d0dfd8b1869 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:16.948294 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-0c7be9ce-f428-4fb0-90bf-ba87f3cb556d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.153530 Feb 08 16:45:16.949256 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 278/549] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:16 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:16.973221 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-b712cc9b-227e-496a-a7e8-3d0dfd8b1869 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042863 Feb 08 16:45:16.973763 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 272/550] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:45:16 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:45:17.151069 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-404a44fd-be79-4ec2-9c59-e83e7280bec9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:17.151683 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-404a44fd-be79-4ec2-9c59-e83e7280bec9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:17.157768 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-404a44fd-be79-4ec2-9c59-e83e7280bec9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:17.158230 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-404a44fd-be79-4ec2-9c59-e83e7280bec9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:17.159014 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-404a44fd-be79-4ec2-9c59-e83e7280bec9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:17.159453 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-404a44fd-be79-4ec2-9c59-e83e7280bec9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:17.289643 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-404a44fd-be79-4ec2-9c59-e83e7280bec9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:17.296924 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-404a44fd-be79-4ec2-9c59-e83e7280bec9 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.149728 Feb 08 16:45:17.297489 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 279/551] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:17 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:17.964768 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-af46a40c-a637-413d-a5f8-304759796b92 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:17.965410 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-af46a40c-a637-413d-a5f8-304759796b92 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:17.971508 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-af46a40c-a637-413d-a5f8-304759796b92 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:17.971996 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-af46a40c-a637-413d-a5f8-304759796b92 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:17.973258 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-af46a40c-a637-413d-a5f8-304759796b92 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:17.973691 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-af46a40c-a637-413d-a5f8-304759796b92 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:17.985125 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-1de7790b-05f8-4276-97f7-7c3aed10962b tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:17.987272 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-1de7790b-05f8-4276-97f7-7c3aed10962b tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:17.994367 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1de7790b-05f8-4276-97f7-7c3aed10962b tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:17.995069 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1de7790b-05f8-4276-97f7-7c3aed10962b tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:17.995899 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1de7790b-05f8-4276-97f7-7c3aed10962b tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:17.996333 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1de7790b-05f8-4276-97f7-7c3aed10962b tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:18.033172 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-1de7790b-05f8-4276-97f7-7c3aed10962b tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051025 Feb 08 16:45:18.035058 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 280/552] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:45:17 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:45:18.114343 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-af46a40c-a637-413d-a5f8-304759796b92 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:18.122485 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-af46a40c-a637-413d-a5f8-304759796b92 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.161383 Feb 08 16:45:18.123518 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 273/553] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:17 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:18.313751 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-15939795-2585-4bee-8d05-68499ed994b4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:18.314368 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-15939795-2585-4bee-8d05-68499ed994b4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:18.320510 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-15939795-2585-4bee-8d05-68499ed994b4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:18.320964 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-15939795-2585-4bee-8d05-68499ed994b4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:18.321752 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-15939795-2585-4bee-8d05-68499ed994b4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:18.322194 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-15939795-2585-4bee-8d05-68499ed994b4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:18.456407 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-15939795-2585-4bee-8d05-68499ed994b4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:18.464377 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-15939795-2585-4bee-8d05-68499ed994b4 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.154270 Feb 08 16:45:18.464948 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 281/554] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:18 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:19.045029 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-5b72fc77-3a5d-44a8-9330-378921465688 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:19.045948 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-5b72fc77-3a5d-44a8-9330-378921465688 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:19.052332 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5b72fc77-3a5d-44a8-9330-378921465688 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:19.052785 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5b72fc77-3a5d-44a8-9330-378921465688 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:19.053565 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5b72fc77-3a5d-44a8-9330-378921465688 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:19.054032 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5b72fc77-3a5d-44a8-9330-378921465688 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:19.085541 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-5b72fc77-3a5d-44a8-9330-378921465688 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044260 Feb 08 16:45:19.086104 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 274/555] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:45:19 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:45:19.141574 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-bab421ab-6788-4aa2-87c4-1dba9c27e0ad tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:19.142175 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-bab421ab-6788-4aa2-87c4-1dba9c27e0ad tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:19.150738 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bab421ab-6788-4aa2-87c4-1dba9c27e0ad tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:19.151194 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bab421ab-6788-4aa2-87c4-1dba9c27e0ad tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:19.152228 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bab421ab-6788-4aa2-87c4-1dba9c27e0ad tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:19.152666 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bab421ab-6788-4aa2-87c4-1dba9c27e0ad tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:19.291987 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-bab421ab-6788-4aa2-87c4-1dba9c27e0ad tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:19.299250 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-bab421ab-6788-4aa2-87c4-1dba9c27e0ad tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.163160 Feb 08 16:45:19.299830 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 282/556] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:19 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:19.481065 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-32c88c49-f2aa-4f0e-9346-fadc5238fe36 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:19.481611 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-32c88c49-f2aa-4f0e-9346-fadc5238fe36 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:19.487518 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-32c88c49-f2aa-4f0e-9346-fadc5238fe36 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:19.488009 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-32c88c49-f2aa-4f0e-9346-fadc5238fe36 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:19.489386 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-32c88c49-f2aa-4f0e-9346-fadc5238fe36 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:19.489836 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-32c88c49-f2aa-4f0e-9346-fadc5238fe36 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:19.624027 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-32c88c49-f2aa-4f0e-9346-fadc5238fe36 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:19.631362 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-32c88c49-f2aa-4f0e-9346-fadc5238fe36 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.153992 Feb 08 16:45:19.631948 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 275/557] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:19 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:20.096785 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-472e3a25-2286-4081-bdb4-4676b05591a1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:20.097848 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-472e3a25-2286-4081-bdb4-4676b05591a1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:20.103951 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-472e3a25-2286-4081-bdb4-4676b05591a1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:20.104487 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-472e3a25-2286-4081-bdb4-4676b05591a1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:20.105362 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-472e3a25-2286-4081-bdb4-4676b05591a1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:20.105886 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-472e3a25-2286-4081-bdb4-4676b05591a1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:20.136299 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-472e3a25-2286-4081-bdb4-4676b05591a1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043291 Feb 08 16:45:20.136873 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 283/558] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:45:20 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:45:20.316485 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-2f729077-7e1a-47d0-9873-5b87d4740144 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:20.317921 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-2f729077-7e1a-47d0-9873-5b87d4740144 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:20.323891 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2f729077-7e1a-47d0-9873-5b87d4740144 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:20.324344 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2f729077-7e1a-47d0-9873-5b87d4740144 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:20.325119 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2f729077-7e1a-47d0-9873-5b87d4740144 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:20.325554 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2f729077-7e1a-47d0-9873-5b87d4740144 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:20.479881 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-2f729077-7e1a-47d0-9873-5b87d4740144 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:20.487374 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-2f729077-7e1a-47d0-9873-5b87d4740144 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.174656 Feb 08 16:45:20.487996 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 276/559] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:20 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:45:20.648332 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b318eb47-63d4-4f88-b328-773c18852412 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:20.649074 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b318eb47-63d4-4f88-b328-773c18852412 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:20.655885 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b318eb47-63d4-4f88-b328-773c18852412 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:20.656344 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b318eb47-63d4-4f88-b328-773c18852412 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:20.657127 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b318eb47-63d4-4f88-b328-773c18852412 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:20.657569 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b318eb47-63d4-4f88-b328-773c18852412 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:20.790891 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b318eb47-63d4-4f88-b328-773c18852412 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:20.798078 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b318eb47-63d4-4f88-b328-773c18852412 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.154037 Feb 08 16:45:20.798665 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 284/560] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:20 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:21.147941 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ab76646d-a461-49b2-9992-20272382deb1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:21.148844 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-ab76646d-a461-49b2-9992-20272382deb1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:21.154668 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ab76646d-a461-49b2-9992-20272382deb1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:21.155119 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ab76646d-a461-49b2-9992-20272382deb1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:21.155933 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ab76646d-a461-49b2-9992-20272382deb1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:21.156371 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ab76646d-a461-49b2-9992-20272382deb1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:21.186931 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-ab76646d-a461-49b2-9992-20272382deb1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042946 Feb 08 16:45:21.187878 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 277/561] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:45:21 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:45:21.504805 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-0a73dbe3-0d02-4846-8e56-0b99b27d005d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:21.505421 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-0a73dbe3-0d02-4846-8e56-0b99b27d005d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:21.511416 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0a73dbe3-0d02-4846-8e56-0b99b27d005d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:21.511915 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0a73dbe3-0d02-4846-8e56-0b99b27d005d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:21.512728 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0a73dbe3-0d02-4846-8e56-0b99b27d005d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:21.513165 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0a73dbe3-0d02-4846-8e56-0b99b27d005d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:21.646806 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-0a73dbe3-0d02-4846-8e56-0b99b27d005d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:21.656101 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-0a73dbe3-0d02-4846-8e56-0b99b27d005d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.155379 Feb 08 16:45:21.656728 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 285/562] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:21 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:21.815385 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e3e64e65-7b43-4b30-b3f8-82bb0bfd0809 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:21.816012 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e3e64e65-7b43-4b30-b3f8-82bb0bfd0809 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:21.822499 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e3e64e65-7b43-4b30-b3f8-82bb0bfd0809 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:21.822886 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e3e64e65-7b43-4b30-b3f8-82bb0bfd0809 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:21.823648 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e3e64e65-7b43-4b30-b3f8-82bb0bfd0809 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:21.824107 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e3e64e65-7b43-4b30-b3f8-82bb0bfd0809 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:21.959375 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e3e64e65-7b43-4b30-b3f8-82bb0bfd0809 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:21.966692 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e3e64e65-7b43-4b30-b3f8-82bb0bfd0809 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.154931 Feb 08 16:45:21.967246 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 278/563] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:21 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:22.198866 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b47f33b9-37a4-46b8-9d55-b16eaf09f7f7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:22.199709 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b47f33b9-37a4-46b8-9d55-b16eaf09f7f7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:22.205573 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b47f33b9-37a4-46b8-9d55-b16eaf09f7f7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:22.206018 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b47f33b9-37a4-46b8-9d55-b16eaf09f7f7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:22.206781 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b47f33b9-37a4-46b8-9d55-b16eaf09f7f7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:22.208012 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b47f33b9-37a4-46b8-9d55-b16eaf09f7f7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:22.236056 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b47f33b9-37a4-46b8-9d55-b16eaf09f7f7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040967 Feb 08 16:45:22.236615 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 286/564] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:45:22 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:45:22.674042 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-5be0856d-42c2-40d9-96d8-4988a650efd1 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:22.674947 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-5be0856d-42c2-40d9-96d8-4988a650efd1 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:22.681839 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5be0856d-42c2-40d9-96d8-4988a650efd1 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:22.682289 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5be0856d-42c2-40d9-96d8-4988a650efd1 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:22.683069 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5be0856d-42c2-40d9-96d8-4988a650efd1 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:22.683500 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5be0856d-42c2-40d9-96d8-4988a650efd1 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:22.817081 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-5be0856d-42c2-40d9-96d8-4988a650efd1 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:22.824808 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-5be0856d-42c2-40d9-96d8-4988a650efd1 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.154413 Feb 08 16:45:22.825373 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 279/565] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:22 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:22.983559 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-3f28c20c-5ea0-4928-a79d-c35023815867 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:22.984237 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-3f28c20c-5ea0-4928-a79d-c35023815867 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:22.991104 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3f28c20c-5ea0-4928-a79d-c35023815867 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:22.991567 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3f28c20c-5ea0-4928-a79d-c35023815867 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:22.992386 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3f28c20c-5ea0-4928-a79d-c35023815867 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:22.992831 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3f28c20c-5ea0-4928-a79d-c35023815867 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:23.123212 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3f28c20c-5ea0-4928-a79d-c35023815867 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:23.131227 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-3f28c20c-5ea0-4928-a79d-c35023815867 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.151294 Feb 08 16:45:23.131820 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 287/566] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:22 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:23.247996 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-27887035-358e-43ec-a070-b206628958a7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:23.248910 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-27887035-358e-43ec-a070-b206628958a7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:23.254988 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-27887035-358e-43ec-a070-b206628958a7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:23.255437 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-27887035-358e-43ec-a070-b206628958a7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:23.256253 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-27887035-358e-43ec-a070-b206628958a7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:23.256690 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-27887035-358e-43ec-a070-b206628958a7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:23.287455 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-27887035-358e-43ec-a070-b206628958a7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043122 Feb 08 16:45:23.287977 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 280/567] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:45:23 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:45:23.840100 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-0330527e-3890-4b8c-b5cd-dcb2c7b3b393 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:23.840702 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-0330527e-3890-4b8c-b5cd-dcb2c7b3b393 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:23.846576 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0330527e-3890-4b8c-b5cd-dcb2c7b3b393 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:23.847022 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0330527e-3890-4b8c-b5cd-dcb2c7b3b393 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:23.847808 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0330527e-3890-4b8c-b5cd-dcb2c7b3b393 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:23.848244 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0330527e-3890-4b8c-b5cd-dcb2c7b3b393 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:23.982677 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-0330527e-3890-4b8c-b5cd-dcb2c7b3b393 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:23.991022 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-0330527e-3890-4b8c-b5cd-dcb2c7b3b393 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.154604 Feb 08 16:45:23.991601 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 288/568] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:23 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:24.147026 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-702ab255-78e8-4ba1-9fad-ec830313b8f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:24.147572 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-702ab255-78e8-4ba1-9fad-ec830313b8f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:24.154087 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-702ab255-78e8-4ba1-9fad-ec830313b8f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:24.154531 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-702ab255-78e8-4ba1-9fad-ec830313b8f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:24.155302 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-702ab255-78e8-4ba1-9fad-ec830313b8f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:24.155732 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-702ab255-78e8-4ba1-9fad-ec830313b8f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:24.289320 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-702ab255-78e8-4ba1-9fad-ec830313b8f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:24.296608 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-702ab255-78e8-4ba1-9fad-ec830313b8f1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.153266 Feb 08 16:45:24.297161 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 281/569] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:24 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:24.298362 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-be8dc526-7617-492e-87b1-aae0dbeca756 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:24.299346 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-be8dc526-7617-492e-87b1-aae0dbeca756 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:24.307800 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-be8dc526-7617-492e-87b1-aae0dbeca756 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:24.307800 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-be8dc526-7617-492e-87b1-aae0dbeca756 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:24.307800 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-be8dc526-7617-492e-87b1-aae0dbeca756 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:24.307800 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-be8dc526-7617-492e-87b1-aae0dbeca756 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:24.337597 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-be8dc526-7617-492e-87b1-aae0dbeca756 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042974 Feb 08 16:45:24.338141 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 289/570] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:45:24 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:45:25.008476 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-4a315be8-e365-455f-a40a-9c35196aa584 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:25.009082 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4a315be8-e365-455f-a40a-9c35196aa584 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:25.014984 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4a315be8-e365-455f-a40a-9c35196aa584 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:25.015436 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4a315be8-e365-455f-a40a-9c35196aa584 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:25.016240 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4a315be8-e365-455f-a40a-9c35196aa584 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:25.016680 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4a315be8-e365-455f-a40a-9c35196aa584 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:25.159356 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4a315be8-e365-455f-a40a-9c35196aa584 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:25.167473 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-4a315be8-e365-455f-a40a-9c35196aa584 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.163237 Feb 08 16:45:25.168087 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 282/571] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:25 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:25.313908 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-7a47bf2b-15d0-4205-8c08-9fcf477f31f6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:25.314599 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-7a47bf2b-15d0-4205-8c08-9fcf477f31f6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:25.320951 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7a47bf2b-15d0-4205-8c08-9fcf477f31f6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:25.321487 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7a47bf2b-15d0-4205-8c08-9fcf477f31f6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:25.322346 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7a47bf2b-15d0-4205-8c08-9fcf477f31f6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:25.322884 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7a47bf2b-15d0-4205-8c08-9fcf477f31f6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:25.348861 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-bfad9177-9fb0-480a-92c9-981537388236 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:25.350538 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-bfad9177-9fb0-480a-92c9-981537388236 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:25.361360 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bfad9177-9fb0-480a-92c9-981537388236 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:25.361896 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bfad9177-9fb0-480a-92c9-981537388236 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:25.362760 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bfad9177-9fb0-480a-92c9-981537388236 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:25.363290 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bfad9177-9fb0-480a-92c9-981537388236 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:25.395300 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-bfad9177-9fb0-480a-92c9-981537388236 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050240 Feb 08 16:45:25.396144 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 283/572] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:45:25 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 08 16:45:25.501418 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-f2afc0c1-9455-45c7-8a73-00cb10fa884a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-628372959", "imageRef": "d70d3911-14f2-4cba-9283-bf4bef4fb526", "flavorRef": "452", "networks": [{"uuid": "ec8f7fac-5fb6-486d-81c6-a643c1dc738e"}]}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:45:25.560945 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-7a47bf2b-15d0-4205-8c08-9fcf477f31f6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:25.561968 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.network.neutron [None req-f2afc0c1-9455-45c7-8a73-00cb10fa884a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] validate_networks() for [('ec8f7fac-5fb6-486d-81c6-a643c1dc738e', None, None, None, None, None)] {{(pid=122901) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 16:45:25.568810 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-7a47bf2b-15d0-4205-8c08-9fcf477f31f6 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1520 microversion: 2.1 time: 0.258810 Feb 08 16:45:25.569475 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 290/573] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:25 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:25.620653 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-2c549cd9-3208-4480-9b09-b4126a8c5990 req-0a495843-ae2e-4b1f-852b-cb40ec1f5fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46b82748-ebae-4771-b414-3feb285df38d", "name": "network-vif-deleted", "tag": "c74e45fa-8736-4935-9ded-fac78de32cfe"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:45:25.622595 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:45:25.622595 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:45:25.632204 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-2c549cd9-3208-4480-9b09-b4126a8c5990 req-0a495843-ae2e-4b1f-852b-cb40ec1f5fb5 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:25.633011 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-2c549cd9-3208-4480-9b09-b4126a8c5990 req-0a495843-ae2e-4b1f-852b-cb40ec1f5fb5 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:25.658644 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-2c549cd9-3208-4480-9b09-b4126a8c5990 req-0a495843-ae2e-4b1f-852b-cb40ec1f5fb5 service nova] Creating event network-vif-deleted:c74e45fa-8736-4935-9ded-fac78de32cfe for instance 46b82748-ebae-4771-b414-3feb285df38d on hv-cinder-82786 Feb 08 16:45:25.664723 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-2c549cd9-3208-4480-9b09-b4126a8c5990 req-0a495843-ae2e-4b1f-852b-cb40ec1f5fb5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050040 Feb 08 16:45:25.665915 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 291/574] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:45:25.944126 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-f2afc0c1-9455-45c7-8a73-00cb10fa884a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Flavor limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 16:45:25.944546 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-f2afc0c1-9455-45c7-8a73-00cb10fa884a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Image limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 16:45:25.945008 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-f2afc0c1-9455-45c7-8a73-00cb10fa884a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Flavor pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 16:45:25.945409 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-f2afc0c1-9455-45c7-8a73-00cb10fa884a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Image pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 16:45:25.945813 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-f2afc0c1-9455-45c7-8a73-00cb10fa884a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 16:45:25.954304 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f2afc0c1-9455-45c7-8a73-00cb10fa884a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:25.954740 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f2afc0c1-9455-45c7-8a73-00cb10fa884a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:25.955537 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f2afc0c1-9455-45c7-8a73-00cb10fa884a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:25.955999 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f2afc0c1-9455-45c7-8a73-00cb10fa884a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:25.972396 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-f2afc0c1-9455-45c7-8a73-00cb10fa884a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Getting quotas for project 3b57fcb90a594af1b70daaecbf9efd96. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:45:25.976785 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-f2afc0c1-9455-45c7-8a73-00cb10fa884a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Getting quotas for user a5eff85a200a4a599e0cefe8d681d72d and project 3b57fcb90a594af1b70daaecbf9efd96. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:45:25.986971 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-f2afc0c1-9455-45c7-8a73-00cb10fa884a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Going to run 1 instances... {{(pid=122901) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 16:45:25.989265 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-f2afc0c1-9455-45c7-8a73-00cb10fa884a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d70d3911-14f2-4cba-9283-bf4bef4fb526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122901) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 16:45:26.032686 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-f2afc0c1-9455-45c7-8a73-00cb10fa884a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535614 Feb 08 16:45:26.033255 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 284/575] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Feb 8 16:45:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 08 16:45:26.043805 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-a1ec7408-dee6-42b6-bf62-217dda9269de tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:26.044574 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-a1ec7408-dee6-42b6-bf62-217dda9269de tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:26.098694 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-a1ec7408-dee6-42b6-bf62-217dda9269de tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:26.106054 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-a1ec7408-dee6-42b6-bf62-217dda9269de tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1217 microversion: 2.1 time: 0.066213 Feb 08 16:45:26.106649 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 292/576] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:26 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:26.183944 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-db9828da-6dd7-4778-abf3-8bda60f3cca5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:26.184555 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-db9828da-6dd7-4778-abf3-8bda60f3cca5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:26.190852 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-db9828da-6dd7-4778-abf3-8bda60f3cca5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:26.191300 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-db9828da-6dd7-4778-abf3-8bda60f3cca5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:26.192098 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-db9828da-6dd7-4778-abf3-8bda60f3cca5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:26.192532 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-db9828da-6dd7-4778-abf3-8bda60f3cca5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:26.340658 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-db9828da-6dd7-4778-abf3-8bda60f3cca5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:26.348667 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-db9828da-6dd7-4778-abf3-8bda60f3cca5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.168222 Feb 08 16:45:26.349444 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 285/577] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:26 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:26.586002 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-5c021160-11a7-4ef2-a0a1-42447d873cc8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:26.586623 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-5c021160-11a7-4ef2-a0a1-42447d873cc8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:26.593696 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5c021160-11a7-4ef2-a0a1-42447d873cc8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:26.594155 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5c021160-11a7-4ef2-a0a1-42447d873cc8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:26.594941 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5c021160-11a7-4ef2-a0a1-42447d873cc8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:26.595384 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5c021160-11a7-4ef2-a0a1-42447d873cc8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:26.631516 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5c021160-11a7-4ef2-a0a1-42447d873cc8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:26.631995 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5c021160-11a7-4ef2-a0a1-42447d873cc8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:26.632451 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.objects.instance [None req-5c021160-11a7-4ef2-a0a1-42447d873cc8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lazy-loading 'fault' on Instance uuid 46b82748-ebae-4771-b414-3feb285df38d {{(pid=122902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:45:26.674876 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-5c021160-11a7-4ef2-a0a1-42447d873cc8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:26.682728 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-5c021160-11a7-4ef2-a0a1-42447d873cc8 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1311 microversion: 2.1 time: 0.100878 Feb 08 16:45:26.683287 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 293/578] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:26 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:27.122178 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b20d2ba7-96f0-4c3c-8204-876503466f6e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:27.122704 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-b20d2ba7-96f0-4c3c-8204-876503466f6e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:27.128873 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b20d2ba7-96f0-4c3c-8204-876503466f6e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:27.129314 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b20d2ba7-96f0-4c3c-8204-876503466f6e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:27.130071 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b20d2ba7-96f0-4c3c-8204-876503466f6e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:27.130988 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b20d2ba7-96f0-4c3c-8204-876503466f6e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:27.189460 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-b20d2ba7-96f0-4c3c-8204-876503466f6e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:27.197905 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-b20d2ba7-96f0-4c3c-8204-876503466f6e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1221 microversion: 2.1 time: 0.079405 Feb 08 16:45:27.198485 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 286/579] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:27 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:27.366088 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-df1497c7-45ff-4426-8e02-d6ed940d4a94 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:27.366745 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-df1497c7-45ff-4426-8e02-d6ed940d4a94 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:27.372638 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-df1497c7-45ff-4426-8e02-d6ed940d4a94 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:27.373038 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-df1497c7-45ff-4426-8e02-d6ed940d4a94 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:27.373819 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-df1497c7-45ff-4426-8e02-d6ed940d4a94 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:27.374300 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-df1497c7-45ff-4426-8e02-d6ed940d4a94 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:27.512047 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-df1497c7-45ff-4426-8e02-d6ed940d4a94 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:27.519355 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-df1497c7-45ff-4426-8e02-d6ed940d4a94 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.157644 Feb 08 16:45:27.519952 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 294/580] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:27 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:27.699563 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-c4ad3eab-c263-4597-8d4c-b111f8552127 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:27.700217 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-c4ad3eab-c263-4597-8d4c-b111f8552127 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:27.706192 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c4ad3eab-c263-4597-8d4c-b111f8552127 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:27.706647 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c4ad3eab-c263-4597-8d4c-b111f8552127 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:27.707427 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c4ad3eab-c263-4597-8d4c-b111f8552127 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:27.707892 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c4ad3eab-c263-4597-8d4c-b111f8552127 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:27.737834 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c4ad3eab-c263-4597-8d4c-b111f8552127 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:27.738286 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c4ad3eab-c263-4597-8d4c-b111f8552127 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:27.738725 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.objects.instance [None req-c4ad3eab-c263-4597-8d4c-b111f8552127 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lazy-loading 'fault' on Instance uuid 46b82748-ebae-4771-b414-3feb285df38d {{(pid=122901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:45:27.781177 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c4ad3eab-c263-4597-8d4c-b111f8552127 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:27.788848 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-c4ad3eab-c263-4597-8d4c-b111f8552127 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1311 microversion: 2.1 time: 0.092930 Feb 08 16:45:27.789413 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 287/581] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:27 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1311 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:28.218187 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-cf07f051-c556-43d2-b011-e4ddf8e48269 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:28.218841 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-cf07f051-c556-43d2-b011-e4ddf8e48269 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:28.226338 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cf07f051-c556-43d2-b011-e4ddf8e48269 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:28.226790 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cf07f051-c556-43d2-b011-e4ddf8e48269 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:28.227586 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cf07f051-c556-43d2-b011-e4ddf8e48269 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:28.228055 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cf07f051-c556-43d2-b011-e4ddf8e48269 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:28.286919 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-cf07f051-c556-43d2-b011-e4ddf8e48269 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:28.295039 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-cf07f051-c556-43d2-b011-e4ddf8e48269 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1221 microversion: 2.1 time: 0.080523 Feb 08 16:45:28.295604 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 295/582] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:28 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1221 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:28.535736 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-749a20be-6e6b-4400-a0dc-81b287f27582 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:28.536306 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-749a20be-6e6b-4400-a0dc-81b287f27582 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:28.542831 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-749a20be-6e6b-4400-a0dc-81b287f27582 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:28.543273 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-749a20be-6e6b-4400-a0dc-81b287f27582 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:28.544095 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-749a20be-6e6b-4400-a0dc-81b287f27582 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:28.544524 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-749a20be-6e6b-4400-a0dc-81b287f27582 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:28.677359 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-749a20be-6e6b-4400-a0dc-81b287f27582 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:28.684665 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-749a20be-6e6b-4400-a0dc-81b287f27582 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.152606 Feb 08 16:45:28.685222 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 288/583] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:28 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:28.805667 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-78dd1c1d-63c0-4637-96d5-bebafcd88d0d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:28.806192 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-78dd1c1d-63c0-4637-96d5-bebafcd88d0d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:28.812304 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-78dd1c1d-63c0-4637-96d5-bebafcd88d0d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:28.812748 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-78dd1c1d-63c0-4637-96d5-bebafcd88d0d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:28.813507 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-78dd1c1d-63c0-4637-96d5-bebafcd88d0d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:28.813940 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-78dd1c1d-63c0-4637-96d5-bebafcd88d0d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:28.844816 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-78dd1c1d-63c0-4637-96d5-bebafcd88d0d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:28.845269 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-78dd1c1d-63c0-4637-96d5-bebafcd88d0d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:28.845720 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.objects.instance [None req-78dd1c1d-63c0-4637-96d5-bebafcd88d0d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lazy-loading 'fault' on Instance uuid 46b82748-ebae-4771-b414-3feb285df38d {{(pid=122902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:45:28.885830 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-78dd1c1d-63c0-4637-96d5-bebafcd88d0d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:28.893181 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-78dd1c1d-63c0-4637-96d5-bebafcd88d0d tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1311 microversion: 2.1 time: 0.091692 Feb 08 16:45:28.893742 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 296/584] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:28 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:29.312201 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b1dd3d3f-cd27-47d1-9013-8a315af16677 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:29.313508 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-b1dd3d3f-cd27-47d1-9013-8a315af16677 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:29.319465 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b1dd3d3f-cd27-47d1-9013-8a315af16677 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:29.320077 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b1dd3d3f-cd27-47d1-9013-8a315af16677 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:29.320889 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b1dd3d3f-cd27-47d1-9013-8a315af16677 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:29.321336 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b1dd3d3f-cd27-47d1-9013-8a315af16677 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:29.381588 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-b1dd3d3f-cd27-47d1-9013-8a315af16677 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:29.388863 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-b1dd3d3f-cd27-47d1-9013-8a315af16677 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1221 microversion: 2.1 time: 0.081655 Feb 08 16:45:29.389423 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 289/585] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:29 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1221 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:29.700038 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b77a171f-0300-4352-acaa-cef7ae6aa0f0 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:29.700648 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b77a171f-0300-4352-acaa-cef7ae6aa0f0 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:29.706878 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b77a171f-0300-4352-acaa-cef7ae6aa0f0 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:29.707326 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b77a171f-0300-4352-acaa-cef7ae6aa0f0 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:29.708128 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b77a171f-0300-4352-acaa-cef7ae6aa0f0 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:29.708571 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b77a171f-0300-4352-acaa-cef7ae6aa0f0 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:29.842649 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b77a171f-0300-4352-acaa-cef7ae6aa0f0 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:29.849984 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b77a171f-0300-4352-acaa-cef7ae6aa0f0 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.153568 Feb 08 16:45:29.851151 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 297/586] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:29 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:29.909601 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-17fe6ed2-103a-4104-b034-8a76fb00d85c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:29.910202 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-17fe6ed2-103a-4104-b034-8a76fb00d85c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:29.917135 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-17fe6ed2-103a-4104-b034-8a76fb00d85c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:29.917579 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-17fe6ed2-103a-4104-b034-8a76fb00d85c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:29.918348 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-17fe6ed2-103a-4104-b034-8a76fb00d85c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:29.918776 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-17fe6ed2-103a-4104-b034-8a76fb00d85c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:29.948774 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-17fe6ed2-103a-4104-b034-8a76fb00d85c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:29.949214 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-17fe6ed2-103a-4104-b034-8a76fb00d85c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:29.949652 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.objects.instance [None req-17fe6ed2-103a-4104-b034-8a76fb00d85c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lazy-loading 'fault' on Instance uuid 46b82748-ebae-4771-b414-3feb285df38d {{(pid=122901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:45:29.991463 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-17fe6ed2-103a-4104-b034-8a76fb00d85c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:29.998962 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-17fe6ed2-103a-4104-b034-8a76fb00d85c tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1311 microversion: 2.1 time: 0.092933 Feb 08 16:45:29.999521 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 290/587] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:29 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1311 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:30.405417 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-8c735098-a8ef-4a68-8b01-26e9bbf14114 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:30.406023 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-8c735098-a8ef-4a68-8b01-26e9bbf14114 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:30.412061 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8c735098-a8ef-4a68-8b01-26e9bbf14114 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:30.412530 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8c735098-a8ef-4a68-8b01-26e9bbf14114 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:30.413390 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8c735098-a8ef-4a68-8b01-26e9bbf14114 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:30.413935 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8c735098-a8ef-4a68-8b01-26e9bbf14114 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:30.477784 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-8c735098-a8ef-4a68-8b01-26e9bbf14114 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:30.485050 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-8c735098-a8ef-4a68-8b01-26e9bbf14114 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1221 microversion: 2.1 time: 0.083523 Feb 08 16:45:30.485622 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 298/588] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:30 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:30.867994 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-3e063941-f314-41c8-ac00-9e2f97577f1f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:30.868611 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-3e063941-f314-41c8-ac00-9e2f97577f1f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:30.874499 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3e063941-f314-41c8-ac00-9e2f97577f1f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:30.874949 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3e063941-f314-41c8-ac00-9e2f97577f1f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:30.875724 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3e063941-f314-41c8-ac00-9e2f97577f1f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:30.876192 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3e063941-f314-41c8-ac00-9e2f97577f1f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:31.016252 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-1d2f4471-cf18-4d33-9298-07d123a7e7e1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:31.016796 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-3e063941-f314-41c8-ac00-9e2f97577f1f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:31.017196 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-1d2f4471-cf18-4d33-9298-07d123a7e7e1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:31.023551 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1d2f4471-cf18-4d33-9298-07d123a7e7e1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:31.024068 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1d2f4471-cf18-4d33-9298-07d123a7e7e1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:31.024869 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1d2f4471-cf18-4d33-9298-07d123a7e7e1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:31.025310 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1d2f4471-cf18-4d33-9298-07d123a7e7e1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:31.026801 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-3e063941-f314-41c8-ac00-9e2f97577f1f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.163274 Feb 08 16:45:31.027898 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 291/589] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:30 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:31.059411 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1d2f4471-cf18-4d33-9298-07d123a7e7e1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:31.059899 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1d2f4471-cf18-4d33-9298-07d123a7e7e1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:31.060350 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.objects.instance [None req-1d2f4471-cf18-4d33-9298-07d123a7e7e1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lazy-loading 'fault' on Instance uuid 46b82748-ebae-4771-b414-3feb285df38d {{(pid=122902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:45:31.099185 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-1d2f4471-cf18-4d33-9298-07d123a7e7e1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e3f764b9f34256bc91f08bc220c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637df1e7f2cb48c0b97d67658900335d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:31.107085 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-1d2f4471-cf18-4d33-9298-07d123a7e7e1 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 200 len: 1311 microversion: 2.1 time: 0.094555 Feb 08 16:45:31.107655 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 299/590] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:31 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:31.502579 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-9da34e81-409d-4dd4-882c-a29291624ae4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:31.503661 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-9da34e81-409d-4dd4-882c-a29291624ae4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:31.510507 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9da34e81-409d-4dd4-882c-a29291624ae4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:31.511074 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9da34e81-409d-4dd4-882c-a29291624ae4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:31.511984 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9da34e81-409d-4dd4-882c-a29291624ae4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:31.512485 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9da34e81-409d-4dd4-882c-a29291624ae4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:31.576115 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-9da34e81-409d-4dd4-882c-a29291624ae4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:31.583476 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-9da34e81-409d-4dd4-882c-a29291624ae4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1269 microversion: 2.1 time: 0.084985 Feb 08 16:45:31.584085 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 292/591] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:31 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1269 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:32.043457 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-0de4d65c-a287-4f7a-bbee-46e2c893fafd tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:32.044065 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-0de4d65c-a287-4f7a-bbee-46e2c893fafd tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:32.050332 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0de4d65c-a287-4f7a-bbee-46e2c893fafd tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:32.050778 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0de4d65c-a287-4f7a-bbee-46e2c893fafd tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:32.051551 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0de4d65c-a287-4f7a-bbee-46e2c893fafd tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:32.052007 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0de4d65c-a287-4f7a-bbee-46e2c893fafd tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:32.123457 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-acae0d46-9896-4b33-92f2-0434c8b314c7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:32.124113 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-acae0d46-9896-4b33-92f2-0434c8b314c7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] [instance: 46b82748-ebae-4771-b414-3feb285df38d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:32.131392 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-acae0d46-9896-4b33-92f2-0434c8b314c7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:32.133097 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-acae0d46-9896-4b33-92f2-0434c8b314c7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:32.134170 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-acae0d46-9896-4b33-92f2-0434c8b314c7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:32.134685 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-acae0d46-9896-4b33-92f2-0434c8b314c7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:32.156566 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.wsgi [None req-acae0d46-9896-4b33-92f2-0434c8b314c7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] HTTP exception thrown: Instance 46b82748-ebae-4771-b414-3feb285df38d could not be found. Feb 08 16:45:32.157321 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-acae0d46-9896-4b33-92f2-0434c8b314c7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] Returning 404 to user: Instance 46b82748-ebae-4771-b414-3feb285df38d could not be found. {{(pid=122901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:45:32.158254 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-acae0d46-9896-4b33-92f2-0434c8b314c7 tempest-ServerRescueNegativeTestJSON-1329545528 tempest-ServerRescueNegativeTestJSON-1329545528-project] 10.222.0.35 "GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d" status: 404 len: 111 microversion: 2.1 time: 0.038472 Feb 08 16:45:32.158950 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 293/592] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:32 2022] GET /compute/v2.1/servers/46b82748-ebae-4771-b414-3feb285df38d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 08 16:45:32.329836 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-0de4d65c-a287-4f7a-bbee-46e2c893fafd tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:32.340716 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-0de4d65c-a287-4f7a-bbee-46e2c893fafd tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.300744 Feb 08 16:45:32.351913 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 300/593] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:32 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:32.601693 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-9761b676-d128-44f3-926e-4a082d42fb4c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:32.602734 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-9761b676-d128-44f3-926e-4a082d42fb4c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:32.608931 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9761b676-d128-44f3-926e-4a082d42fb4c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:32.609668 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9761b676-d128-44f3-926e-4a082d42fb4c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:32.610802 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9761b676-d128-44f3-926e-4a082d42fb4c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:32.611454 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9761b676-d128-44f3-926e-4a082d42fb4c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:32.938037 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-9761b676-d128-44f3-926e-4a082d42fb4c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:32.946434 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-9761b676-d128-44f3-926e-4a082d42fb4c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1317 microversion: 2.1 time: 0.349202 Feb 08 16:45:32.947304 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 294/594] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:32 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:33.048724 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-bc51779a-99a9-4e33-8512-985eb986c24f req-582ad167-576f-4f58-9cc2-b1fff92e7445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f35dcea-496c-4068-8519-33560beb7168", "tag": "c3b70171-ae78-4aa2-9269-f259a579efd6"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:45:33.051153 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:45:33.051153 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:45:33.059510 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-bc51779a-99a9-4e33-8512-985eb986c24f req-582ad167-576f-4f58-9cc2-b1fff92e7445 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:33.060036 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-bc51779a-99a9-4e33-8512-985eb986c24f req-582ad167-576f-4f58-9cc2-b1fff92e7445 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:33.071895 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-bc51779a-99a9-4e33-8512-985eb986c24f req-582ad167-576f-4f58-9cc2-b1fff92e7445 service nova] Creating event network-changed:c3b70171-ae78-4aa2-9269-f259a579efd6 for instance 2f35dcea-496c-4068-8519-33560beb7168 on hv-cinder-82786 Feb 08 16:45:33.076926 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-bc51779a-99a9-4e33-8512-985eb986c24f req-582ad167-576f-4f58-9cc2-b1fff92e7445 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032095 Feb 08 16:45:33.077529 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 301/595] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:45:33.357273 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-6e296c72-d0a8-47be-bf35-4e6bd114fc7c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:33.358053 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-6e296c72-d0a8-47be-bf35-4e6bd114fc7c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:33.365873 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6e296c72-d0a8-47be-bf35-4e6bd114fc7c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:33.367098 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6e296c72-d0a8-47be-bf35-4e6bd114fc7c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:33.368012 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6e296c72-d0a8-47be-bf35-4e6bd114fc7c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:33.368521 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6e296c72-d0a8-47be-bf35-4e6bd114fc7c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:33.600270 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-6e296c72-d0a8-47be-bf35-4e6bd114fc7c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:33.608313 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-6e296c72-d0a8-47be-bf35-4e6bd114fc7c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.254543 Feb 08 16:45:33.618027 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 295/596] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:33 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:33.963573 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-5fa4d423-6b95-4960-85ef-25b83b044e1e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:33.964609 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-5fa4d423-6b95-4960-85ef-25b83b044e1e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:33.971319 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5fa4d423-6b95-4960-85ef-25b83b044e1e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:33.971798 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5fa4d423-6b95-4960-85ef-25b83b044e1e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:33.972607 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5fa4d423-6b95-4960-85ef-25b83b044e1e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:33.973047 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5fa4d423-6b95-4960-85ef-25b83b044e1e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:34.111307 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-5fa4d423-6b95-4960-85ef-25b83b044e1e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:34.119549 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-5fa4d423-6b95-4960-85ef-25b83b044e1e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1317 microversion: 2.1 time: 0.160691 Feb 08 16:45:34.120190 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 302/597] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:33 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:34.625446 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-f9ac565d-9d38-41c5-98fb-4298a1cf8f11 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:34.626270 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-f9ac565d-9d38-41c5-98fb-4298a1cf8f11 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:34.633529 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f9ac565d-9d38-41c5-98fb-4298a1cf8f11 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:34.634101 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f9ac565d-9d38-41c5-98fb-4298a1cf8f11 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:34.634995 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f9ac565d-9d38-41c5-98fb-4298a1cf8f11 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:34.635566 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f9ac565d-9d38-41c5-98fb-4298a1cf8f11 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:34.874192 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f9ac565d-9d38-41c5-98fb-4298a1cf8f11 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:34.882440 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-f9ac565d-9d38-41c5-98fb-4298a1cf8f11 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.260064 Feb 08 16:45:34.883093 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 296/598] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:34 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:35.138912 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-09d99c28-2db5-4444-b503-64959fe8065f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:35.139523 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-09d99c28-2db5-4444-b503-64959fe8065f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:35.164176 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-09d99c28-2db5-4444-b503-64959fe8065f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:35.164842 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-09d99c28-2db5-4444-b503-64959fe8065f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:35.166528 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-09d99c28-2db5-4444-b503-64959fe8065f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:35.168368 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-09d99c28-2db5-4444-b503-64959fe8065f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:35.214618 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-e9568ddd-7206-49a4-bf74-2d9f7a36f24e req-f2b10e23-1f5b-4ba4-b5fe-fa680d57bc82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f5b0dab-9c28-4519-a6f6-c98d7c9a5287", "name": "network-vif-plugged", "status": "completed", "tag": "6f04fb2f-d81d-42f0-8c53-184ef0859a38"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:45:35.216381 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:45:35.216381 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:45:35.230543 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-e9568ddd-7206-49a4-bf74-2d9f7a36f24e req-f2b10e23-1f5b-4ba4-b5fe-fa680d57bc82 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:35.231119 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-e9568ddd-7206-49a4-bf74-2d9f7a36f24e req-f2b10e23-1f5b-4ba4-b5fe-fa680d57bc82 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:35.246823 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-e9568ddd-7206-49a4-bf74-2d9f7a36f24e req-f2b10e23-1f5b-4ba4-b5fe-fa680d57bc82 service nova] Creating event network-vif-plugged:6f04fb2f-d81d-42f0-8c53-184ef0859a38 for instance 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 on hv-cinder-82786 Feb 08 16:45:35.254247 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-e9568ddd-7206-49a4-bf74-2d9f7a36f24e req-f2b10e23-1f5b-4ba4-b5fe-fa680d57bc82 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044984 Feb 08 16:45:35.255370 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 297/599] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:45:35.331969 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-09d99c28-2db5-4444-b503-64959fe8065f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:35.339646 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-09d99c28-2db5-4444-b503-64959fe8065f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1317 microversion: 2.1 time: 0.204338 Feb 08 16:45:35.340266 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 303/600] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:35 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:35.899442 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-20e76dcf-e2bc-4f17-89ca-24feee015379 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:35.900275 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-20e76dcf-e2bc-4f17-89ca-24feee015379 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:35.907204 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-20e76dcf-e2bc-4f17-89ca-24feee015379 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:35.907646 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-20e76dcf-e2bc-4f17-89ca-24feee015379 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:35.908473 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-20e76dcf-e2bc-4f17-89ca-24feee015379 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:35.908897 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-20e76dcf-e2bc-4f17-89ca-24feee015379 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:36.068137 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-20e76dcf-e2bc-4f17-89ca-24feee015379 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:36.076835 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-20e76dcf-e2bc-4f17-89ca-24feee015379 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.181972 Feb 08 16:45:36.077408 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 298/601] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:35 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:36.356497 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-ae791c86-a4d0-488c-ad4b-893f3cb78c0e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:36.357102 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-ae791c86-a4d0-488c-ad4b-893f3cb78c0e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:36.363192 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ae791c86-a4d0-488c-ad4b-893f3cb78c0e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:36.363640 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ae791c86-a4d0-488c-ad4b-893f3cb78c0e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:36.364450 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ae791c86-a4d0-488c-ad4b-893f3cb78c0e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:36.364883 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ae791c86-a4d0-488c-ad4b-893f3cb78c0e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:36.500332 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ae791c86-a4d0-488c-ad4b-893f3cb78c0e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:36.507822 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-ae791c86-a4d0-488c-ad4b-893f3cb78c0e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1317 microversion: 2.1 time: 0.154848 Feb 08 16:45:36.508574 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 304/602] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:36 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:36.787524 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-77787cbc-4afe-42fc-ba5f-66e69c6450cc tempest-VolumesNegativeTest-149802594 tempest-VolumesNegativeTest-149802594-project] Action: 'create', calling method: .version_select at 0x7fcde0202ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1153075403", "metadata": {"Type": "work"}}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:45:36.788986 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-77787cbc-4afe-42fc-ba5f-66e69c6450cc tempest-VolumesNegativeTest-149802594 tempest-VolumesNegativeTest-149802594-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:45:36.789785 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-77787cbc-4afe-42fc-ba5f-66e69c6450cc tempest-VolumesNegativeTest-149802594 tempest-VolumesNegativeTest-149802594-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.134687 Feb 08 16:45:36.790309 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 299/603] 10.222.0.35 () {60 vars in 1155 bytes} [Tue Feb 8 16:45:36 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 08 16:45:36.799995 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b3233989-6169-4c26-8ab2-9a51dbc8df95 tempest-VolumesNegativeTest-149802594 tempest-VolumesNegativeTest-149802594-project] Action: 'create', calling method: .version_select at 0x7fcde01c58b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1540216411", "metadata": {"Type": "work"}}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:45:36.801443 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b3233989-6169-4c26-8ab2-9a51dbc8df95 tempest-VolumesNegativeTest-149802594 tempest-VolumesNegativeTest-149802594-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:45:36.802233 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b3233989-6169-4c26-8ab2-9a51dbc8df95 tempest-VolumesNegativeTest-149802594 tempest-VolumesNegativeTest-149802594-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.005819 Feb 08 16:45:36.802738 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 305/604] 10.222.0.35 () {60 vars in 1155 bytes} [Tue Feb 8 16:45:36 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 08 16:45:36.811152 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d792dbd9-6aa3-4ceb-bf4b-e9950590b66f tempest-VolumesNegativeTest-149802594 tempest-VolumesNegativeTest-149802594-project] Action: 'create', calling method: .version_select at 0x7fcde02c2160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-849302664", "metadata": {"Type": "work"}}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:45:36.812365 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d792dbd9-6aa3-4ceb-bf4b-e9950590b66f tempest-VolumesNegativeTest-149802594 tempest-VolumesNegativeTest-149802594-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:45:36.813150 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d792dbd9-6aa3-4ceb-bf4b-e9950590b66f tempest-VolumesNegativeTest-149802594 tempest-VolumesNegativeTest-149802594-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005581 Feb 08 16:45:36.813656 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 300/605] 10.222.0.35 () {60 vars in 1155 bytes} [Tue Feb 8 16:45:36 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 08 16:45:36.822408 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-ae53016e-e9c1-4989-b860-10c2178f616f tempest-VolumesNegativeTest-149802594 tempest-VolumesNegativeTest-149802594-project] Calling method '.version_select at 0x7fcde01fa670>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:36.852103 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-ae53016e-e9c1-4989-b860-10c2178f616f tempest-VolumesNegativeTest-149802594 tempest-VolumesNegativeTest-149802594-project] HTTP exception thrown: Volume tempest-invalid-840778912 could not be found. Feb 08 16:45:36.852729 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-ae53016e-e9c1-4989-b860-10c2178f616f tempest-VolumesNegativeTest-149802594 tempest-VolumesNegativeTest-149802594-project] Returning 404 to user: Volume tempest-invalid-840778912 could not be found. {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:45:36.853578 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-ae53016e-e9c1-4989-b860-10c2178f616f tempest-VolumesNegativeTest-149802594 tempest-VolumesNegativeTest-149802594-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/tempest-invalid-840778912" status: 404 len: 98 microversion: 2.1 time: 0.035297 Feb 08 16:45:36.854108 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 306/606] 10.222.0.35 () {58 vars in 1214 bytes} [Tue Feb 8 16:45:36 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-840778912 => generated 98 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 08 16:45:36.868388 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-91247502-a9f1-4b19-8739-6bbcc2c058a8 tempest-VolumesNegativeTest-149802594 tempest-VolumesNegativeTest-149802594-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007509 Feb 08 16:45:36.869328 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 301/607] 10.222.0.35 () {58 vars in 1139 bytes} [Tue Feb 8 16:45:36 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 08 16:45:36.877493 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-2d1ee17f-435b-4b51-9609-e7b6dedf6113 tempest-VolumesNegativeTest-149802594 tempest-VolumesNegativeTest-149802594-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003461 Feb 08 16:45:36.878015 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 307/608] 10.222.0.35 () {58 vars in 1136 bytes} [Tue Feb 8 16:45:36 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 08 16:45:36.886603 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d2cc7bcc-c9a9-4b93-bdfa-4332dce69fc8 tempest-VolumesNegativeTest-149802594 tempest-VolumesNegativeTest-149802594-project] Calling method '.version_select at 0x7fcde02ffee0>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:36.913979 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.wsgi [None req-d2cc7bcc-c9a9-4b93-bdfa-4332dce69fc8 tempest-VolumesNegativeTest-149802594 tempest-VolumesNegativeTest-149802594-project] HTTP exception thrown: Volume 35805485-74e5-41ad-8db8-32de1b1ef209 could not be found. Feb 08 16:45:36.914616 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d2cc7bcc-c9a9-4b93-bdfa-4332dce69fc8 tempest-VolumesNegativeTest-149802594 tempest-VolumesNegativeTest-149802594-project] Returning 404 to user: Volume 35805485-74e5-41ad-8db8-32de1b1ef209 could not be found. {{(pid=122901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:45:36.915485 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d2cc7bcc-c9a9-4b93-bdfa-4332dce69fc8 tempest-VolumesNegativeTest-149802594 tempest-VolumesNegativeTest-149802594-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/35805485-74e5-41ad-8db8-32de1b1ef209" status: 404 len: 109 microversion: 2.1 time: 0.032367 Feb 08 16:45:36.916120 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 302/609] 10.222.0.35 () {58 vars in 1247 bytes} [Tue Feb 8 16:45:36 2022] DELETE /compute/v2.1/os-volumes/35805485-74e5-41ad-8db8-32de1b1ef209 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:45:36.925057 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-3e9b02ec-4430-4113-9578-36a8571e377d tempest-VolumesNegativeTest-149802594 tempest-VolumesNegativeTest-149802594-project] Calling method '.version_select at 0x7fcde01fac10>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:36.951872 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-3e9b02ec-4430-4113-9578-36a8571e377d tempest-VolumesNegativeTest-149802594 tempest-VolumesNegativeTest-149802594-project] HTTP exception thrown: Volume c21f1677-aba3-4bb3-9da1-01bdeb1a005f could not be found. Feb 08 16:45:36.952468 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-3e9b02ec-4430-4113-9578-36a8571e377d tempest-VolumesNegativeTest-149802594 tempest-VolumesNegativeTest-149802594-project] Returning 404 to user: Volume c21f1677-aba3-4bb3-9da1-01bdeb1a005f could not be found. {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:45:36.953292 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-3e9b02ec-4430-4113-9578-36a8571e377d tempest-VolumesNegativeTest-149802594 tempest-VolumesNegativeTest-149802594-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/c21f1677-aba3-4bb3-9da1-01bdeb1a005f" status: 404 len: 109 microversion: 2.1 time: 0.032092 Feb 08 16:45:36.953825 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 308/610] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Feb 8 16:45:36 2022] GET /compute/v2.1/os-volumes/c21f1677-aba3-4bb3-9da1-01bdeb1a005f => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:45:37.094189 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-df676bcf-c5e5-47a2-b08c-024b970277e7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:37.094804 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-df676bcf-c5e5-47a2-b08c-024b970277e7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:37.101725 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-df676bcf-c5e5-47a2-b08c-024b970277e7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:37.102172 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-df676bcf-c5e5-47a2-b08c-024b970277e7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:37.102987 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-df676bcf-c5e5-47a2-b08c-024b970277e7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:37.103584 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-df676bcf-c5e5-47a2-b08c-024b970277e7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:37.247133 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-df676bcf-c5e5-47a2-b08c-024b970277e7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:37.254675 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-df676bcf-c5e5-47a2-b08c-024b970277e7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.164056 Feb 08 16:45:37.255244 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 303/611] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:37 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:37.527152 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-7326c15b-d6f5-415e-9067-4a73bebf02d2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:37.530684 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-7326c15b-d6f5-415e-9067-4a73bebf02d2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:37.537358 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7326c15b-d6f5-415e-9067-4a73bebf02d2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:37.539625 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7326c15b-d6f5-415e-9067-4a73bebf02d2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:37.541846 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7326c15b-d6f5-415e-9067-4a73bebf02d2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:37.543006 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7326c15b-d6f5-415e-9067-4a73bebf02d2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:37.739280 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-7326c15b-d6f5-415e-9067-4a73bebf02d2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:37.750452 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-7326c15b-d6f5-415e-9067-4a73bebf02d2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1317 microversion: 2.1 time: 0.229253 Feb 08 16:45:37.751649 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 309/612] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:37 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:38.270034 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-402b546f-d32d-4089-bf1a-0681597e1f9a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:38.270643 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-402b546f-d32d-4089-bf1a-0681597e1f9a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:38.277498 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-402b546f-d32d-4089-bf1a-0681597e1f9a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:38.277943 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-402b546f-d32d-4089-bf1a-0681597e1f9a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:38.278728 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-402b546f-d32d-4089-bf1a-0681597e1f9a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:38.279156 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-402b546f-d32d-4089-bf1a-0681597e1f9a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:38.415482 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-402b546f-d32d-4089-bf1a-0681597e1f9a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:38.422771 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-402b546f-d32d-4089-bf1a-0681597e1f9a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.156342 Feb 08 16:45:38.423339 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 304/613] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:38 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:38.767933 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c60caea6-4650-45a7-80b7-d2de243409d9 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:38.768535 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c60caea6-4650-45a7-80b7-d2de243409d9 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:38.774752 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c60caea6-4650-45a7-80b7-d2de243409d9 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:38.775400 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c60caea6-4650-45a7-80b7-d2de243409d9 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:38.776227 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c60caea6-4650-45a7-80b7-d2de243409d9 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:38.776742 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c60caea6-4650-45a7-80b7-d2de243409d9 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:38.962896 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c60caea6-4650-45a7-80b7-d2de243409d9 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:38.971847 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c60caea6-4650-45a7-80b7-d2de243409d9 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1317 microversion: 2.1 time: 0.207423 Feb 08 16:45:38.972424 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 310/614] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:38 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:45:39.439136 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-9b5d77e4-a604-46aa-897e-e7026cfc64a6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:39.439676 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-9b5d77e4-a604-46aa-897e-e7026cfc64a6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:39.446809 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9b5d77e4-a604-46aa-897e-e7026cfc64a6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:39.447262 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9b5d77e4-a604-46aa-897e-e7026cfc64a6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:39.448077 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9b5d77e4-a604-46aa-897e-e7026cfc64a6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:39.448533 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9b5d77e4-a604-46aa-897e-e7026cfc64a6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:39.581322 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-9b5d77e4-a604-46aa-897e-e7026cfc64a6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:39.588528 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-9b5d77e4-a604-46aa-897e-e7026cfc64a6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.153069 Feb 08 16:45:39.589087 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 305/615] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:39 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:39.988923 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-69c61a92-6975-4576-b686-b3106870b80f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:39.989516 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-69c61a92-6975-4576-b686-b3106870b80f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:39.996612 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-69c61a92-6975-4576-b686-b3106870b80f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:39.997069 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-69c61a92-6975-4576-b686-b3106870b80f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:39.997874 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-69c61a92-6975-4576-b686-b3106870b80f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:39.998327 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-69c61a92-6975-4576-b686-b3106870b80f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:40.178259 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-69c61a92-6975-4576-b686-b3106870b80f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:40.186704 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-69c61a92-6975-4576-b686-b3106870b80f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1317 microversion: 2.1 time: 0.201567 Feb 08 16:45:40.187403 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 311/616] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:39 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:40.612813 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-9e18fc7d-b6a9-48df-8447-671415382d6d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:40.613500 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-9e18fc7d-b6a9-48df-8447-671415382d6d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:40.620862 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9e18fc7d-b6a9-48df-8447-671415382d6d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:40.621361 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9e18fc7d-b6a9-48df-8447-671415382d6d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:40.622329 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9e18fc7d-b6a9-48df-8447-671415382d6d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:40.622836 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9e18fc7d-b6a9-48df-8447-671415382d6d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:40.770304 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-9e18fc7d-b6a9-48df-8447-671415382d6d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:40.778395 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-9e18fc7d-b6a9-48df-8447-671415382d6d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1258 microversion: 2.1 time: 0.169158 Feb 08 16:45:40.788421 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 306/617] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:40 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:41.204899 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-9271494d-d47c-48d2-8f5c-5ae6febdd6b2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:41.205520 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-9271494d-d47c-48d2-8f5c-5ae6febdd6b2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:41.212228 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9271494d-d47c-48d2-8f5c-5ae6febdd6b2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:41.212738 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9271494d-d47c-48d2-8f5c-5ae6febdd6b2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:41.213607 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9271494d-d47c-48d2-8f5c-5ae6febdd6b2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:41.214054 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9271494d-d47c-48d2-8f5c-5ae6febdd6b2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:41.450998 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9271494d-d47c-48d2-8f5c-5ae6febdd6b2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:41.458200 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-9271494d-d47c-48d2-8f5c-5ae6febdd6b2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1317 microversion: 2.1 time: 0.257171 Feb 08 16:45:41.459162 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 312/618] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:41 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:41.796508 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-2c050e67-7d36-4b57-903c-a8ee07f15c01 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:41.797738 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-2c050e67-7d36-4b57-903c-a8ee07f15c01 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:41.804742 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2c050e67-7d36-4b57-903c-a8ee07f15c01 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:41.805453 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2c050e67-7d36-4b57-903c-a8ee07f15c01 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:41.806418 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2c050e67-7d36-4b57-903c-a8ee07f15c01 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:41.806858 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2c050e67-7d36-4b57-903c-a8ee07f15c01 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:41.962024 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-2c050e67-7d36-4b57-903c-a8ee07f15c01 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:41.969913 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-2c050e67-7d36-4b57-903c-a8ee07f15c01 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1442 microversion: 2.1 time: 0.177425 Feb 08 16:45:41.971121 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 307/619] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:41 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1442 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:41.987042 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-3f504ef5-885b-4975-8638-10d38a074e99 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:41.987655 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-3f504ef5-885b-4975-8638-10d38a074e99 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:41.996200 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3f504ef5-885b-4975-8638-10d38a074e99 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:41.996888 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3f504ef5-885b-4975-8638-10d38a074e99 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:41.997790 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3f504ef5-885b-4975-8638-10d38a074e99 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:41.998220 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3f504ef5-885b-4975-8638-10d38a074e99 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:42.186167 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3f504ef5-885b-4975-8638-10d38a074e99 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:42.193978 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-3f504ef5-885b-4975-8638-10d38a074e99 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1442 microversion: 2.1 time: 0.210589 Feb 08 16:45:42.194546 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 313/620] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:41 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1442 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:42.232580 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-7107aeb0-acd6-4500-8dc0-3d1fb8da2f83 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:42.233075 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7107aeb0-acd6-4500-8dc0-3d1fb8da2f83 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:42.238877 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7107aeb0-acd6-4500-8dc0-3d1fb8da2f83 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:42.239324 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7107aeb0-acd6-4500-8dc0-3d1fb8da2f83 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:42.240135 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7107aeb0-acd6-4500-8dc0-3d1fb8da2f83 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:42.240568 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7107aeb0-acd6-4500-8dc0-3d1fb8da2f83 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:42.332920 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.objects.instance [None req-7107aeb0-acd6-4500-8dc0-3d1fb8da2f83 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lazy-loading 'services' on Instance uuid b66ad307-27dc-4150-b8c8-fe488dca0906 {{(pid=122901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:45:42.406535 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-7107aeb0-acd6-4500-8dc0-3d1fb8da2f83 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906/os-volume_attachments/f19c1472-510a-4cff-a1df-ecc7d17d20aa" status: 202 len: 0 microversion: 2.1 time: 0.177366 Feb 08 16:45:42.407464 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 308/621] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Feb 8 16:45:42 2022] DELETE /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906/os-volume_attachments/f19c1472-510a-4cff-a1df-ecc7d17d20aa => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:45:42.476039 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-90d23551-7201-43b5-93c5-42f836e0e827 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:42.476901 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-90d23551-7201-43b5-93c5-42f836e0e827 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:42.483588 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-90d23551-7201-43b5-93c5-42f836e0e827 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:42.484318 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-90d23551-7201-43b5-93c5-42f836e0e827 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:42.485326 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-90d23551-7201-43b5-93c5-42f836e0e827 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:42.485769 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-90d23551-7201-43b5-93c5-42f836e0e827 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:42.629556 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-90d23551-7201-43b5-93c5-42f836e0e827 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:42.637783 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-90d23551-7201-43b5-93c5-42f836e0e827 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1317 microversion: 2.1 time: 0.165488 Feb 08 16:45:42.638390 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 314/622] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:42 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:43.656368 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-8ec9b02d-12a9-4e8b-8ae9-5df571cbdcf4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:43.657172 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-8ec9b02d-12a9-4e8b-8ae9-5df571cbdcf4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:43.666233 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8ec9b02d-12a9-4e8b-8ae9-5df571cbdcf4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:43.666688 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8ec9b02d-12a9-4e8b-8ae9-5df571cbdcf4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:43.667481 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8ec9b02d-12a9-4e8b-8ae9-5df571cbdcf4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:43.667949 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8ec9b02d-12a9-4e8b-8ae9-5df571cbdcf4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:43.943901 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-8ec9b02d-12a9-4e8b-8ae9-5df571cbdcf4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:43.951156 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-8ec9b02d-12a9-4e8b-8ae9-5df571cbdcf4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1317 microversion: 2.1 time: 0.299171 Feb 08 16:45:43.951721 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 309/623] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:43 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:44.319243 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-6d701df6-9e63-424d-83b0-07fc07f57634 req-2e1e68b1-cf47-47ad-b92b-35c77af83f06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f5b0dab-9c28-4519-a6f6-c98d7c9a5287", "tag": "6f04fb2f-d81d-42f0-8c53-184ef0859a38"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:45:44.325059 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:45:44.325059 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:45:44.331299 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-6d701df6-9e63-424d-83b0-07fc07f57634 req-2e1e68b1-cf47-47ad-b92b-35c77af83f06 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:44.331777 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-6d701df6-9e63-424d-83b0-07fc07f57634 req-2e1e68b1-cf47-47ad-b92b-35c77af83f06 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:44.346908 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-6d701df6-9e63-424d-83b0-07fc07f57634 req-2e1e68b1-cf47-47ad-b92b-35c77af83f06 service nova] Creating event network-changed:6f04fb2f-d81d-42f0-8c53-184ef0859a38 for instance 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 on hv-cinder-82786 Feb 08 16:45:44.352585 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-6d701df6-9e63-424d-83b0-07fc07f57634 req-2e1e68b1-cf47-47ad-b92b-35c77af83f06 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037252 Feb 08 16:45:44.353083 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 315/624] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:45:44.967560 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-5e5084de-d928-48cb-877c-6f9e8e1cf294 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:44.968192 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-5e5084de-d928-48cb-877c-6f9e8e1cf294 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:44.974949 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5e5084de-d928-48cb-877c-6f9e8e1cf294 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:44.975403 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5e5084de-d928-48cb-877c-6f9e8e1cf294 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:44.976228 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5e5084de-d928-48cb-877c-6f9e8e1cf294 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:44.977247 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5e5084de-d928-48cb-877c-6f9e8e1cf294 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:45.117969 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-5e5084de-d928-48cb-877c-6f9e8e1cf294 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:45.125300 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-5e5084de-d928-48cb-877c-6f9e8e1cf294 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1317 microversion: 2.1 time: 0.161388 Feb 08 16:45:45.125945 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 310/625] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:44 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:46.142522 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-cf8edf58-8261-4c45-8da0-3ae8810cffd6 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:46.143153 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-cf8edf58-8261-4c45-8da0-3ae8810cffd6 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:46.149792 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cf8edf58-8261-4c45-8da0-3ae8810cffd6 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:46.150249 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cf8edf58-8261-4c45-8da0-3ae8810cffd6 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:46.151032 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cf8edf58-8261-4c45-8da0-3ae8810cffd6 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:46.151475 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cf8edf58-8261-4c45-8da0-3ae8810cffd6 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:46.286298 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-cf8edf58-8261-4c45-8da0-3ae8810cffd6 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:46.293844 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-cf8edf58-8261-4c45-8da0-3ae8810cffd6 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1317 microversion: 2.1 time: 0.155437 Feb 08 16:45:46.294405 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 316/626] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:46 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:47.310091 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-814ac585-9a8e-4561-a0cc-180a78ec0d1c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:47.311517 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-814ac585-9a8e-4561-a0cc-180a78ec0d1c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:47.318095 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-814ac585-9a8e-4561-a0cc-180a78ec0d1c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:47.318539 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-814ac585-9a8e-4561-a0cc-180a78ec0d1c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:47.319317 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-814ac585-9a8e-4561-a0cc-180a78ec0d1c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:47.319745 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-814ac585-9a8e-4561-a0cc-180a78ec0d1c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:47.453250 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-814ac585-9a8e-4561-a0cc-180a78ec0d1c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:47.460425 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-814ac585-9a8e-4561-a0cc-180a78ec0d1c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1317 microversion: 2.1 time: 0.154172 Feb 08 16:45:47.461781 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 311/627] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:47 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:48.477025 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-769df9f9-0131-4289-985e-31be0f6d7148 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:48.477637 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-769df9f9-0131-4289-985e-31be0f6d7148 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:48.484035 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-769df9f9-0131-4289-985e-31be0f6d7148 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:48.484485 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-769df9f9-0131-4289-985e-31be0f6d7148 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:48.485258 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-769df9f9-0131-4289-985e-31be0f6d7148 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:48.485692 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-769df9f9-0131-4289-985e-31be0f6d7148 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:48.626094 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-769df9f9-0131-4289-985e-31be0f6d7148 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:48.633651 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-769df9f9-0131-4289-985e-31be0f6d7148 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1317 microversion: 2.1 time: 0.160570 Feb 08 16:45:48.634298 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 317/628] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:48 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:48.811317 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-06764544-44a8-4699-bad0-f8c5469cf9fe tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:48.811873 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-06764544-44a8-4699-bad0-f8c5469cf9fe tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:48.820361 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-06764544-44a8-4699-bad0-f8c5469cf9fe tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:48.820820 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-06764544-44a8-4699-bad0-f8c5469cf9fe tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:48.821635 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-06764544-44a8-4699-bad0-f8c5469cf9fe tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:48.822073 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-06764544-44a8-4699-bad0-f8c5469cf9fe tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:48.847858 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-06764544-44a8-4699-bad0-f8c5469cf9fe tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Going to try to terminate instance {{(pid=122901) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 16:45:48.924027 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-06764544-44a8-4699-bad0-f8c5469cf9fe tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 204 len: 0 microversion: 2.1 time: 0.115954 Feb 08 16:45:48.924695 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 312/629] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Feb 8 16:45:48 2022] DELETE /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 08 16:45:48.934683 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b436f4ce-2330-49f1-832d-9d49e835ae95 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:48.935339 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b436f4ce-2330-49f1-832d-9d49e835ae95 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:48.941280 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b436f4ce-2330-49f1-832d-9d49e835ae95 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:48.941732 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b436f4ce-2330-49f1-832d-9d49e835ae95 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:48.942511 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b436f4ce-2330-49f1-832d-9d49e835ae95 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:48.942950 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b436f4ce-2330-49f1-832d-9d49e835ae95 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:49.076365 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b436f4ce-2330-49f1-832d-9d49e835ae95 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:49.083590 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b436f4ce-2330-49f1-832d-9d49e835ae95 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1513 microversion: 2.1 time: 0.153766 Feb 08 16:45:49.084185 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 318/630] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:48 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:45:49.651256 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-67898ca5-253c-40e2-a757-41ce1f76a58c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:49.652218 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-67898ca5-253c-40e2-a757-41ce1f76a58c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:49.658069 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-67898ca5-253c-40e2-a757-41ce1f76a58c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:49.658513 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-67898ca5-253c-40e2-a757-41ce1f76a58c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:49.659280 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-67898ca5-253c-40e2-a757-41ce1f76a58c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:49.659704 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-67898ca5-253c-40e2-a757-41ce1f76a58c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:49.793914 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-67898ca5-253c-40e2-a757-41ce1f76a58c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:49.801091 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-67898ca5-253c-40e2-a757-41ce1f76a58c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1317 microversion: 2.1 time: 0.155221 Feb 08 16:45:49.801728 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 313/631] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:49 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:50.099980 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-5499f1c2-cf40-4507-a358-adce70450dce tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:50.100593 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-5499f1c2-cf40-4507-a358-adce70450dce tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:50.107499 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5499f1c2-cf40-4507-a358-adce70450dce tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:50.107985 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5499f1c2-cf40-4507-a358-adce70450dce tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:50.108761 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5499f1c2-cf40-4507-a358-adce70450dce tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:50.109197 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5499f1c2-cf40-4507-a358-adce70450dce tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:50.243302 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-5499f1c2-cf40-4507-a358-adce70450dce tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:50.251022 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-5499f1c2-cf40-4507-a358-adce70450dce tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1513 microversion: 2.1 time: 0.154749 Feb 08 16:45:50.251591 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 319/632] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:50 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:50.817773 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-98ee3166-c3b2-4ebc-9f91-e7f457e0ecee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:50.818176 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-98ee3166-c3b2-4ebc-9f91-e7f457e0ecee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:50.825149 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-98ee3166-c3b2-4ebc-9f91-e7f457e0ecee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:50.825661 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-98ee3166-c3b2-4ebc-9f91-e7f457e0ecee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:50.826499 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-98ee3166-c3b2-4ebc-9f91-e7f457e0ecee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:50.827018 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-98ee3166-c3b2-4ebc-9f91-e7f457e0ecee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:50.963285 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-98ee3166-c3b2-4ebc-9f91-e7f457e0ecee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:50.971404 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-98ee3166-c3b2-4ebc-9f91-e7f457e0ecee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1317 microversion: 2.1 time: 0.157762 Feb 08 16:45:50.972019 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 314/633] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:50 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:51.271485 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-69e7824a-c621-4ca6-9497-18ea06be8b2e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:51.272550 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-69e7824a-c621-4ca6-9497-18ea06be8b2e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:51.279823 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-69e7824a-c621-4ca6-9497-18ea06be8b2e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:51.281801 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-69e7824a-c621-4ca6-9497-18ea06be8b2e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:51.285356 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-69e7824a-c621-4ca6-9497-18ea06be8b2e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:51.288135 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-69e7824a-c621-4ca6-9497-18ea06be8b2e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:51.367535 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-d0561a72-c9a5-4c9f-b041-378f6a882b3a req-e0087d46-a7cc-40f3-a517-f303ad800e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f35dcea-496c-4068-8519-33560beb7168", "name": "network-vif-plugged", "status": "completed", "tag": "c3b70171-ae78-4aa2-9269-f259a579efd6"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:45:51.369450 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:45:51.369450 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:45:51.380265 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-d0561a72-c9a5-4c9f-b041-378f6a882b3a req-e0087d46-a7cc-40f3-a517-f303ad800e6f service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:51.381135 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-d0561a72-c9a5-4c9f-b041-378f6a882b3a req-e0087d46-a7cc-40f3-a517-f303ad800e6f service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:51.398972 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-d0561a72-c9a5-4c9f-b041-378f6a882b3a req-e0087d46-a7cc-40f3-a517-f303ad800e6f service nova] Creating event network-vif-plugged:c3b70171-ae78-4aa2-9269-f259a579efd6 for instance 2f35dcea-496c-4068-8519-33560beb7168 on hv-cinder-82786 Feb 08 16:45:51.408083 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-d0561a72-c9a5-4c9f-b041-378f6a882b3a req-e0087d46-a7cc-40f3-a517-f303ad800e6f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044622 Feb 08 16:45:51.409040 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 315/634] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:45:51.581721 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-69e7824a-c621-4ca6-9497-18ea06be8b2e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:51.594401 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-69e7824a-c621-4ca6-9497-18ea06be8b2e tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 200 len: 1513 microversion: 2.1 time: 0.330139 Feb 08 16:45:51.595049 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 320/635] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:51 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 1513 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:51.909205 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-c12d2e1e-a8bf-471f-97b4-c16ed142859e req-bfb6211d-d270-4599-baea-eefc932845f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66ad307-27dc-4150-b8c8-fe488dca0906", "name": "network-vif-deleted", "tag": "7b51cb9a-da70-41bd-8fd9-16b61091a7c2"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:45:51.910919 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:45:51.910919 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:45:51.919071 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-c12d2e1e-a8bf-471f-97b4-c16ed142859e req-bfb6211d-d270-4599-baea-eefc932845f1 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:51.919591 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-c12d2e1e-a8bf-471f-97b4-c16ed142859e req-bfb6211d-d270-4599-baea-eefc932845f1 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:51.929914 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-c12d2e1e-a8bf-471f-97b4-c16ed142859e req-bfb6211d-d270-4599-baea-eefc932845f1 service nova] Creating event network-vif-deleted:7b51cb9a-da70-41bd-8fd9-16b61091a7c2 for instance b66ad307-27dc-4150-b8c8-fe488dca0906 on hv-cinder-82786 Feb 08 16:45:51.934914 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-c12d2e1e-a8bf-471f-97b4-c16ed142859e req-bfb6211d-d270-4599-baea-eefc932845f1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029547 Feb 08 16:45:51.935575 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 316/636] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:45:51.988251 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-88065bd8-18be-4977-9d5f-bd09e7944771 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:51.988866 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-88065bd8-18be-4977-9d5f-bd09e7944771 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:51.995371 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-88065bd8-18be-4977-9d5f-bd09e7944771 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:51.995868 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-88065bd8-18be-4977-9d5f-bd09e7944771 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:51.996656 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-88065bd8-18be-4977-9d5f-bd09e7944771 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:51.997126 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-88065bd8-18be-4977-9d5f-bd09e7944771 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:52.152090 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-88065bd8-18be-4977-9d5f-bd09e7944771 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:52.159860 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-88065bd8-18be-4977-9d5f-bd09e7944771 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1317 microversion: 2.1 time: 0.175010 Feb 08 16:45:52.160454 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 321/637] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:51 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:52.613282 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-fb0f3f8a-f80a-4052-bffe-9a5eb532b80c tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:52.614613 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-fb0f3f8a-f80a-4052-bffe-9a5eb532b80c tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: b66ad307-27dc-4150-b8c8-fe488dca0906] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:52.621689 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fb0f3f8a-f80a-4052-bffe-9a5eb532b80c tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:52.622923 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fb0f3f8a-f80a-4052-bffe-9a5eb532b80c tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:52.624187 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fb0f3f8a-f80a-4052-bffe-9a5eb532b80c tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:52.624804 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fb0f3f8a-f80a-4052-bffe-9a5eb532b80c tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:52.641533 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.wsgi [None req-fb0f3f8a-f80a-4052-bffe-9a5eb532b80c tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] HTTP exception thrown: Instance b66ad307-27dc-4150-b8c8-fe488dca0906 could not be found. Feb 08 16:45:52.642417 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-fb0f3f8a-f80a-4052-bffe-9a5eb532b80c tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Returning 404 to user: Instance b66ad307-27dc-4150-b8c8-fe488dca0906 could not be found. {{(pid=122901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:45:52.644159 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-fb0f3f8a-f80a-4052-bffe-9a5eb532b80c tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906" status: 404 len: 111 microversion: 2.1 time: 0.034845 Feb 08 16:45:52.645255 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 317/638] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:52 2022] GET /compute/v2.1/servers/b66ad307-27dc-4150-b8c8-fe488dca0906 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:45:53.177431 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-d2ae9d6c-0055-4124-acce-da99bcbf6991 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:53.178044 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-d2ae9d6c-0055-4124-acce-da99bcbf6991 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:53.185148 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d2ae9d6c-0055-4124-acce-da99bcbf6991 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:53.185602 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d2ae9d6c-0055-4124-acce-da99bcbf6991 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:53.186392 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d2ae9d6c-0055-4124-acce-da99bcbf6991 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:53.186824 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d2ae9d6c-0055-4124-acce-da99bcbf6991 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:53.343168 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-d2ae9d6c-0055-4124-acce-da99bcbf6991 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:53.351464 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-d2ae9d6c-0055-4124-acce-da99bcbf6991 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1317 microversion: 2.1 time: 0.177605 Feb 08 16:45:53.352175 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 322/639] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:53 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:54.370817 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b39fcdaf-e53e-4e62-b9b4-e48745254b23 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:45:54.370817 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-b39fcdaf-e53e-4e62-b9b4-e48745254b23 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:54.377144 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b39fcdaf-e53e-4e62-b9b4-e48745254b23 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:54.377590 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b39fcdaf-e53e-4e62-b9b4-e48745254b23 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:54.378829 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b39fcdaf-e53e-4e62-b9b4-e48745254b23 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:54.379263 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b39fcdaf-e53e-4e62-b9b4-e48745254b23 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:54.528287 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-b39fcdaf-e53e-4e62-b9b4-e48745254b23 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:45:54.535477 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-b39fcdaf-e53e-4e62-b9b4-e48745254b23 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1508 microversion: 2.1 time: 0.171075 Feb 08 16:45:54.536063 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 318/640] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:45:54 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:45:59.003595 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-dfb83149-2795-4392-ae52-abf0c5ed7a6f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6dae6165-4c10-46a7-9ca9-79d93d783786"}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:45:59.004726 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-dfb83149-2795-4392-ae52-abf0c5ed7a6f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:45:59.010629 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dfb83149-2795-4392-ae52-abf0c5ed7a6f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:59.011083 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dfb83149-2795-4392-ae52-abf0c5ed7a6f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:59.011862 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dfb83149-2795-4392-ae52-abf0c5ed7a6f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:45:59.012309 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dfb83149-2795-4392-ae52-abf0c5ed7a6f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:45:59.275061 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-dfb83149-2795-4392-ae52-abf0c5ed7a6f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "POST /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275130 Feb 08 16:45:59.276504 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 323/641] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Feb 8 16:45:58 2022] POST /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:46:04.896799 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-3004afcc-c20b-4192-8ec4-623d81c6be68 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:46:04.897319 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-3004afcc-c20b-4192-8ec4-623d81c6be68 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:04.903650 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3004afcc-c20b-4192-8ec4-623d81c6be68 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:04.904127 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3004afcc-c20b-4192-8ec4-623d81c6be68 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:04.904907 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3004afcc-c20b-4192-8ec4-623d81c6be68 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:04.905340 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3004afcc-c20b-4192-8ec4-623d81c6be68 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:04.927578 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.objects.instance [None req-3004afcc-c20b-4192-8ec4-623d81c6be68 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lazy-loading 'flavor' on Instance uuid da00c476-8246-413e-889c-d22fe63e2ef8 {{(pid=122901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:46:05.227373 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-3004afcc-c20b-4192-8ec4-623d81c6be68 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "POST /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/action" status: 202 len: 0 microversion: 2.20 time: 0.334179 Feb 08 16:46:05.228015 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 319/642] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Feb 8 16:46:04 2022] POST /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 08 16:46:05.237576 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e206730e-71c6-4685-9ccb-aa9732cd3898 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:05.238271 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e206730e-71c6-4685-9ccb-aa9732cd3898 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:05.245530 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e206730e-71c6-4685-9ccb-aa9732cd3898 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:05.245993 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e206730e-71c6-4685-9ccb-aa9732cd3898 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:05.246790 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e206730e-71c6-4685-9ccb-aa9732cd3898 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:05.247235 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e206730e-71c6-4685-9ccb-aa9732cd3898 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:05.387241 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e206730e-71c6-4685-9ccb-aa9732cd3898 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:05.394996 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e206730e-71c6-4685-9ccb-aa9732cd3898 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:05.396512 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e206730e-71c6-4685-9ccb-aa9732cd3898 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:05.397658 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e206730e-71c6-4685-9ccb-aa9732cd3898 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1722 microversion: 2.20 time: 0.164692 Feb 08 16:46:05.398218 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 324/643] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:05 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:05.674120 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d92493a5-5319-4483-abd7-fb857ad881dc tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1589675275", "imageRef": "d70d3911-14f2-4cba-9283-bf4bef4fb526", "flavorRef": "452", "networks": [{"uuid": "8fa132bb-f81d-40c5-97f2-e1964294199e"}]}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:46:05.722998 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.network.neutron [None req-d92493a5-5319-4483-abd7-fb857ad881dc tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] validate_networks() for [('8fa132bb-f81d-40c5-97f2-e1964294199e', None, None, None, None, None)] {{(pid=122901) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 16:46:05.835249 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c0b45129-59ac-431d-97dd-73b98342fff9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7704a2a6-585a-4362-8c4d-671d62a1434a"}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:46:05.836613 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c0b45129-59ac-431d-97dd-73b98342fff9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:05.842739 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c0b45129-59ac-431d-97dd-73b98342fff9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:05.843192 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c0b45129-59ac-431d-97dd-73b98342fff9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:05.844013 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c0b45129-59ac-431d-97dd-73b98342fff9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:05.844442 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c0b45129-59ac-431d-97dd-73b98342fff9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:06.101049 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-d92493a5-5319-4483-abd7-fb857ad881dc tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Flavor limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 16:46:06.101568 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-d92493a5-5319-4483-abd7-fb857ad881dc tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Image limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 16:46:06.101959 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-d92493a5-5319-4483-abd7-fb857ad881dc tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Flavor pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 16:46:06.102410 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-d92493a5-5319-4483-abd7-fb857ad881dc tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Image pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 16:46:06.102905 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-d92493a5-5319-4483-abd7-fb857ad881dc tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 16:46:06.114214 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d92493a5-5319-4483-abd7-fb857ad881dc tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:06.114808 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d92493a5-5319-4483-abd7-fb857ad881dc tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:06.115981 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d92493a5-5319-4483-abd7-fb857ad881dc tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:06.116419 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d92493a5-5319-4483-abd7-fb857ad881dc tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:06.123342 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c0b45129-59ac-431d-97dd-73b98342fff9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "POST /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291718 Feb 08 16:46:06.124172 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 325/644] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Feb 8 16:46:05 2022] POST /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:46:06.139786 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-d92493a5-5319-4483-abd7-fb857ad881dc tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Getting quotas for project 55220445da0d49ac8713e9036e8e6e06. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:46:06.143892 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-d92493a5-5319-4483-abd7-fb857ad881dc tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Getting quotas for user 2a7421e6184e497eb23bf9f87957322c and project 55220445da0d49ac8713e9036e8e6e06. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:46:06.157025 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-d92493a5-5319-4483-abd7-fb857ad881dc tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Going to run 1 instances... {{(pid=122901) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 16:46:06.160515 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-d92493a5-5319-4483-abd7-fb857ad881dc tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: c3bef185-a618-44ad-a691-59b9ec1303e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d70d3911-14f2-4cba-9283-bf4bef4fb526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122901) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 16:46:06.215782 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d92493a5-5319-4483-abd7-fb857ad881dc tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545627 Feb 08 16:46:06.216839 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 320/645] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Feb 8 16:46:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 16:46:06.227266 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-0f7150ec-f881-4ccb-8e54-cb34ee017dcc tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:06.228340 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-0f7150ec-f881-4ccb-8e54-cb34ee017dcc tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: c3bef185-a618-44ad-a691-59b9ec1303e8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:06.283039 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-0f7150ec-f881-4ccb-8e54-cb34ee017dcc tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:06.289573 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-0f7150ec-f881-4ccb-8e54-cb34ee017dcc tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8" status: 200 len: 1219 microversion: 2.1 time: 0.066793 Feb 08 16:46:06.290133 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 326/646] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:06 2022] GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:06.417956 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-fb82eb98-1e76-4913-8acd-43e5291d499f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:06.418761 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-fb82eb98-1e76-4913-8acd-43e5291d499f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:06.424937 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fb82eb98-1e76-4913-8acd-43e5291d499f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:06.425645 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fb82eb98-1e76-4913-8acd-43e5291d499f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:06.426167 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fb82eb98-1e76-4913-8acd-43e5291d499f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:06.426605 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fb82eb98-1e76-4913-8acd-43e5291d499f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:06.567127 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-fb82eb98-1e76-4913-8acd-43e5291d499f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:06.576017 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-fb82eb98-1e76-4913-8acd-43e5291d499f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:06.577560 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-fb82eb98-1e76-4913-8acd-43e5291d499f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:06.578718 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-fb82eb98-1e76-4913-8acd-43e5291d499f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1722 microversion: 2.20 time: 0.165555 Feb 08 16:46:06.579276 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 321/647] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:06 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:07.308836 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-48f75ef2-29f5-4109-86a7-9b01f4431791 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:07.310173 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-48f75ef2-29f5-4109-86a7-9b01f4431791 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: c3bef185-a618-44ad-a691-59b9ec1303e8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:07.329028 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-48f75ef2-29f5-4109-86a7-9b01f4431791 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:07.330183 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-48f75ef2-29f5-4109-86a7-9b01f4431791 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:07.332474 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-48f75ef2-29f5-4109-86a7-9b01f4431791 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:07.334193 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-48f75ef2-29f5-4109-86a7-9b01f4431791 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:07.429134 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-48f75ef2-29f5-4109-86a7-9b01f4431791 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:07.437158 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-48f75ef2-29f5-4109-86a7-9b01f4431791 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8" status: 200 len: 1289 microversion: 2.1 time: 0.134127 Feb 08 16:46:07.437816 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 327/648] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:07 2022] GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8 => generated 1289 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:07.597891 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-6cfbe60d-b4c0-4d15-bbfd-65903ed25e0a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:07.598500 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-6cfbe60d-b4c0-4d15-bbfd-65903ed25e0a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:07.605579 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6cfbe60d-b4c0-4d15-bbfd-65903ed25e0a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:07.606028 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6cfbe60d-b4c0-4d15-bbfd-65903ed25e0a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:07.606802 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6cfbe60d-b4c0-4d15-bbfd-65903ed25e0a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:07.607237 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6cfbe60d-b4c0-4d15-bbfd-65903ed25e0a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:07.755092 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-6cfbe60d-b4c0-4d15-bbfd-65903ed25e0a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:07.764889 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-6cfbe60d-b4c0-4d15-bbfd-65903ed25e0a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:07.766385 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-6cfbe60d-b4c0-4d15-bbfd-65903ed25e0a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:07.767733 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-6cfbe60d-b4c0-4d15-bbfd-65903ed25e0a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1722 microversion: 2.20 time: 0.173538 Feb 08 16:46:07.768508 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 322/649] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:07 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:07.949946 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-d8fbc16e-4da6-454b-ad79-034f6c7cbb75 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:07.950439 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-d8fbc16e-4da6-454b-ad79-034f6c7cbb75 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:07.956921 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d8fbc16e-4da6-454b-ad79-034f6c7cbb75 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:07.957362 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d8fbc16e-4da6-454b-ad79-034f6c7cbb75 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:07.958147 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d8fbc16e-4da6-454b-ad79-034f6c7cbb75 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:07.958577 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d8fbc16e-4da6-454b-ad79-034f6c7cbb75 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:08.042502 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.objects.instance [None req-d8fbc16e-4da6-454b-ad79-034f6c7cbb75 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lazy-loading 'services' on Instance uuid 2f35dcea-496c-4068-8519-33560beb7168 {{(pid=122902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:46:08.118052 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-d8fbc16e-4da6-454b-ad79-034f6c7cbb75 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "DELETE /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168/os-volume_attachments/6dae6165-4c10-46a7-9ca9-79d93d783786" status: 202 len: 0 microversion: 2.1 time: 0.172048 Feb 08 16:46:08.119516 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 328/650] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Feb 8 16:46:07 2022] DELETE /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168/os-volume_attachments/6dae6165-4c10-46a7-9ca9-79d93d783786 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:46:08.127601 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-acccb04b-a3a0-45ed-8887-1b1d2ced16b5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:08.128863 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-acccb04b-a3a0-45ed-8887-1b1d2ced16b5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:08.135854 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-acccb04b-a3a0-45ed-8887-1b1d2ced16b5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:08.136305 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-acccb04b-a3a0-45ed-8887-1b1d2ced16b5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:08.137283 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-acccb04b-a3a0-45ed-8887-1b1d2ced16b5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:08.137878 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-acccb04b-a3a0-45ed-8887-1b1d2ced16b5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:08.168860 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-acccb04b-a3a0-45ed-8887-1b1d2ced16b5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044997 Feb 08 16:46:08.169435 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 323/651] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:46:08 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:46:08.456132 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-93641c15-0ba3-4b86-9bfd-4fe03bbd1170 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:08.456834 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-93641c15-0ba3-4b86-9bfd-4fe03bbd1170 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: c3bef185-a618-44ad-a691-59b9ec1303e8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:08.464243 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-93641c15-0ba3-4b86-9bfd-4fe03bbd1170 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:08.464696 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-93641c15-0ba3-4b86-9bfd-4fe03bbd1170 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:08.465486 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-93641c15-0ba3-4b86-9bfd-4fe03bbd1170 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:08.466030 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-93641c15-0ba3-4b86-9bfd-4fe03bbd1170 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:08.669012 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-93641c15-0ba3-4b86-9bfd-4fe03bbd1170 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:08.677311 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-93641c15-0ba3-4b86-9bfd-4fe03bbd1170 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8" status: 200 len: 1319 microversion: 2.1 time: 0.226643 Feb 08 16:46:08.677868 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 329/652] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:08 2022] GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:08.744582 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-b50c5da0-5d17-47cc-be54-e682173062d5 req-aeac8769-0bbc-41fa-8241-982d6aae2d8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3bef185-a618-44ad-a691-59b9ec1303e8", "tag": "caf61fd0-7dff-4794-942a-dd5f8ce46e23"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:46:08.746737 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:46:08.746737 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:46:08.754278 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-b50c5da0-5d17-47cc-be54-e682173062d5 req-aeac8769-0bbc-41fa-8241-982d6aae2d8b service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:08.754970 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-b50c5da0-5d17-47cc-be54-e682173062d5 req-aeac8769-0bbc-41fa-8241-982d6aae2d8b service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:08.766688 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-b50c5da0-5d17-47cc-be54-e682173062d5 req-aeac8769-0bbc-41fa-8241-982d6aae2d8b service nova] Creating event network-changed:caf61fd0-7dff-4794-942a-dd5f8ce46e23 for instance c3bef185-a618-44ad-a691-59b9ec1303e8 on hv-cinder-82786 Feb 08 16:46:08.781581 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-b50c5da0-5d17-47cc-be54-e682173062d5 req-aeac8769-0bbc-41fa-8241-982d6aae2d8b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040655 Feb 08 16:46:08.782202 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 324/653] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:46:08.787239 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-2f01f086-b05e-43d6-922a-b03ea1ec7af6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:08.787950 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-2f01f086-b05e-43d6-922a-b03ea1ec7af6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:08.794955 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2f01f086-b05e-43d6-922a-b03ea1ec7af6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:08.795407 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2f01f086-b05e-43d6-922a-b03ea1ec7af6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:08.796293 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2f01f086-b05e-43d6-922a-b03ea1ec7af6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:08.796729 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2f01f086-b05e-43d6-922a-b03ea1ec7af6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:09.013794 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-2f01f086-b05e-43d6-922a-b03ea1ec7af6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:09.022690 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-2f01f086-b05e-43d6-922a-b03ea1ec7af6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:09.024305 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-2f01f086-b05e-43d6-922a-b03ea1ec7af6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:09.025677 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-2f01f086-b05e-43d6-922a-b03ea1ec7af6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1722 microversion: 2.20 time: 0.242642 Feb 08 16:46:09.026521 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 330/654] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:08 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:46:09.180829 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-9df4198a-86cf-47ed-8260-aec46f1373a1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:09.182879 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-9df4198a-86cf-47ed-8260-aec46f1373a1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:09.189157 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9df4198a-86cf-47ed-8260-aec46f1373a1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:09.189886 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9df4198a-86cf-47ed-8260-aec46f1373a1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:09.191241 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9df4198a-86cf-47ed-8260-aec46f1373a1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:09.192023 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9df4198a-86cf-47ed-8260-aec46f1373a1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:09.229075 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-9df4198a-86cf-47ed-8260-aec46f1373a1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051857 Feb 08 16:46:09.229731 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 325/655] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:46:09 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:46:09.699124 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-eca7935c-cfb7-4ff2-ad2f-9f07c9dfae43 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:09.701185 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-eca7935c-cfb7-4ff2-ad2f-9f07c9dfae43 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: c3bef185-a618-44ad-a691-59b9ec1303e8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:09.709030 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eca7935c-cfb7-4ff2-ad2f-9f07c9dfae43 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:09.709581 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eca7935c-cfb7-4ff2-ad2f-9f07c9dfae43 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:09.710471 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eca7935c-cfb7-4ff2-ad2f-9f07c9dfae43 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:09.711068 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eca7935c-cfb7-4ff2-ad2f-9f07c9dfae43 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:09.932972 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-eca7935c-cfb7-4ff2-ad2f-9f07c9dfae43 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:09.941191 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-eca7935c-cfb7-4ff2-ad2f-9f07c9dfae43 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8" status: 200 len: 1319 microversion: 2.1 time: 0.248741 Feb 08 16:46:09.943430 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 331/656] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:09 2022] GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:10.045623 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-f4d94d1b-8d19-4a36-81e0-43044401d78c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:10.046232 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-f4d94d1b-8d19-4a36-81e0-43044401d78c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:10.052875 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f4d94d1b-8d19-4a36-81e0-43044401d78c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:10.053327 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f4d94d1b-8d19-4a36-81e0-43044401d78c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:10.054116 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f4d94d1b-8d19-4a36-81e0-43044401d78c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:10.054546 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f4d94d1b-8d19-4a36-81e0-43044401d78c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:10.235596 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f4d94d1b-8d19-4a36-81e0-43044401d78c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:10.241402 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e13378dd-b779-4dd3-9eff-f15032f62bc0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:10.242660 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e13378dd-b779-4dd3-9eff-f15032f62bc0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:10.250109 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e13378dd-b779-4dd3-9eff-f15032f62bc0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:10.250912 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e13378dd-b779-4dd3-9eff-f15032f62bc0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:10.251307 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f4d94d1b-8d19-4a36-81e0-43044401d78c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:10.252241 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e13378dd-b779-4dd3-9eff-f15032f62bc0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:10.253120 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e13378dd-b779-4dd3-9eff-f15032f62bc0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:10.253240 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f4d94d1b-8d19-4a36-81e0-43044401d78c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:10.254875 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-f4d94d1b-8d19-4a36-81e0-43044401d78c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1722 microversion: 2.20 time: 0.212986 Feb 08 16:46:10.256403 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 326/657] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:10 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:10.286632 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e13378dd-b779-4dd3-9eff-f15032f62bc0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048588 Feb 08 16:46:10.287482 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 332/658] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:46:10 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:46:10.961620 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-7252fb2e-9d17-491c-a128-2f2e7c9e9184 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:10.962453 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7252fb2e-9d17-491c-a128-2f2e7c9e9184 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: c3bef185-a618-44ad-a691-59b9ec1303e8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:10.969461 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7252fb2e-9d17-491c-a128-2f2e7c9e9184 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:10.969990 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7252fb2e-9d17-491c-a128-2f2e7c9e9184 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:10.970837 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7252fb2e-9d17-491c-a128-2f2e7c9e9184 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:10.971345 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7252fb2e-9d17-491c-a128-2f2e7c9e9184 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:11.137230 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7252fb2e-9d17-491c-a128-2f2e7c9e9184 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:11.145752 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-7252fb2e-9d17-491c-a128-2f2e7c9e9184 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8" status: 200 len: 1319 microversion: 2.1 time: 0.188246 Feb 08 16:46:11.146607 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 327/659] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:10 2022] GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:11.273954 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-6de3f8c4-9039-423f-909b-0784b1ba30fa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:11.274736 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-6de3f8c4-9039-423f-909b-0784b1ba30fa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:11.281702 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6de3f8c4-9039-423f-909b-0784b1ba30fa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:11.282137 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6de3f8c4-9039-423f-909b-0784b1ba30fa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:11.282980 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6de3f8c4-9039-423f-909b-0784b1ba30fa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:11.283339 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6de3f8c4-9039-423f-909b-0784b1ba30fa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:11.298164 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d0ac2a87-f788-4578-b182-891b95eb78a3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:11.299060 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-d0ac2a87-f788-4578-b182-891b95eb78a3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:11.305205 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d0ac2a87-f788-4578-b182-891b95eb78a3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:11.311049 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d0ac2a87-f788-4578-b182-891b95eb78a3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:11.311962 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d0ac2a87-f788-4578-b182-891b95eb78a3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:11.312580 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d0ac2a87-f788-4578-b182-891b95eb78a3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:11.347643 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d0ac2a87-f788-4578-b182-891b95eb78a3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053023 Feb 08 16:46:11.348292 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 328/660] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:46:11 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:46:11.594725 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-6de3f8c4-9039-423f-909b-0784b1ba30fa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:11.604781 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-6de3f8c4-9039-423f-909b-0784b1ba30fa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:11.606669 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-6de3f8c4-9039-423f-909b-0784b1ba30fa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:11.607978 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-6de3f8c4-9039-423f-909b-0784b1ba30fa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1722 microversion: 2.20 time: 0.337795 Feb 08 16:46:11.608940 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 333/661] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:11 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1722 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:12.166525 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-8d4adc77-701a-455e-b32e-34297241ea6d tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:12.167300 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-8d4adc77-701a-455e-b32e-34297241ea6d tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: c3bef185-a618-44ad-a691-59b9ec1303e8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:12.174165 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8d4adc77-701a-455e-b32e-34297241ea6d tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:12.174782 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8d4adc77-701a-455e-b32e-34297241ea6d tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:12.175847 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8d4adc77-701a-455e-b32e-34297241ea6d tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:12.176516 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8d4adc77-701a-455e-b32e-34297241ea6d tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:12.365588 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-fabbffbb-5bb3-4d45-aa8d-5e6d99e7d7e3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:12.373513 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-fabbffbb-5bb3-4d45-aa8d-5e6d99e7d7e3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:12.390397 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fabbffbb-5bb3-4d45-aa8d-5e6d99e7d7e3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:12.390860 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fabbffbb-5bb3-4d45-aa8d-5e6d99e7d7e3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:12.391670 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fabbffbb-5bb3-4d45-aa8d-5e6d99e7d7e3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:12.396252 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fabbffbb-5bb3-4d45-aa8d-5e6d99e7d7e3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:12.460642 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-fabbffbb-5bb3-4d45-aa8d-5e6d99e7d7e3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104453 Feb 08 16:46:12.461237 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 334/662] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:46:12 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:46:12.484853 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-8d4adc77-701a-455e-b32e-34297241ea6d tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:12.499401 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-8d4adc77-701a-455e-b32e-34297241ea6d tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8" status: 200 len: 1319 microversion: 2.1 time: 0.340306 Feb 08 16:46:12.500994 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 329/663] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:12 2022] GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8 => generated 1319 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:12.635653 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-13142252-2d07-4d35-bc43-d3994e9ed274 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:12.636602 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-13142252-2d07-4d35-bc43-d3994e9ed274 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:12.646381 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-13142252-2d07-4d35-bc43-d3994e9ed274 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:12.647946 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-13142252-2d07-4d35-bc43-d3994e9ed274 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:12.653074 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-13142252-2d07-4d35-bc43-d3994e9ed274 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:12.653945 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-13142252-2d07-4d35-bc43-d3994e9ed274 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:12.848500 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-13142252-2d07-4d35-bc43-d3994e9ed274 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:12.860810 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-13142252-2d07-4d35-bc43-d3994e9ed274 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:12.863029 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-13142252-2d07-4d35-bc43-d3994e9ed274 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:12.865787 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-13142252-2d07-4d35-bc43-d3994e9ed274 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1722 microversion: 2.20 time: 0.243659 Feb 08 16:46:12.866535 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 335/664] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:12 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:46:13.474577 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-dcd0282b-8d35-46c4-a60b-e02f7c0a616f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:13.476722 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-dcd0282b-8d35-46c4-a60b-e02f7c0a616f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:13.489908 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dcd0282b-8d35-46c4-a60b-e02f7c0a616f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:13.490742 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dcd0282b-8d35-46c4-a60b-e02f7c0a616f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:13.494952 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dcd0282b-8d35-46c4-a60b-e02f7c0a616f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:13.495793 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-dcd0282b-8d35-46c4-a60b-e02f7c0a616f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:13.516861 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-9e068855-0331-4f23-ba64-d6c4631d5f93 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:13.517625 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-9e068855-0331-4f23-ba64-d6c4631d5f93 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: c3bef185-a618-44ad-a691-59b9ec1303e8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:13.530111 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9e068855-0331-4f23-ba64-d6c4631d5f93 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:13.530509 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9e068855-0331-4f23-ba64-d6c4631d5f93 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:13.531306 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9e068855-0331-4f23-ba64-d6c4631d5f93 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:13.532033 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9e068855-0331-4f23-ba64-d6c4631d5f93 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:13.547054 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-dcd0282b-8d35-46c4-a60b-e02f7c0a616f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077204 Feb 08 16:46:13.548385 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 330/665] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:46:13 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:46:13.783257 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9e068855-0331-4f23-ba64-d6c4631d5f93 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:13.796995 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-9e068855-0331-4f23-ba64-d6c4631d5f93 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8" status: 200 len: 1319 microversion: 2.1 time: 0.283701 Feb 08 16:46:13.797967 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 336/666] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:13 2022] GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8 => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:13.883393 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e4a5a4c9-7497-412f-a5ed-b2533df6f4a8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:13.884044 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e4a5a4c9-7497-412f-a5ed-b2533df6f4a8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:13.890853 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e4a5a4c9-7497-412f-a5ed-b2533df6f4a8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:13.892954 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e4a5a4c9-7497-412f-a5ed-b2533df6f4a8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:13.894209 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e4a5a4c9-7497-412f-a5ed-b2533df6f4a8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:13.895590 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e4a5a4c9-7497-412f-a5ed-b2533df6f4a8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:14.182992 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e4a5a4c9-7497-412f-a5ed-b2533df6f4a8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:14.201087 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e4a5a4c9-7497-412f-a5ed-b2533df6f4a8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:14.204739 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e4a5a4c9-7497-412f-a5ed-b2533df6f4a8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:14.210381 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e4a5a4c9-7497-412f-a5ed-b2533df6f4a8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1722 microversion: 2.20 time: 0.330458 Feb 08 16:46:14.213846 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 331/667] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:13 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1722 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:14.561799 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-1013d480-72ff-4767-8ebd-bf8cf9e05720 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:14.562639 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-1013d480-72ff-4767-8ebd-bf8cf9e05720 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:14.572227 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1013d480-72ff-4767-8ebd-bf8cf9e05720 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:14.572811 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1013d480-72ff-4767-8ebd-bf8cf9e05720 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:14.574690 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1013d480-72ff-4767-8ebd-bf8cf9e05720 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:14.575438 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1013d480-72ff-4767-8ebd-bf8cf9e05720 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:14.611020 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-1013d480-72ff-4767-8ebd-bf8cf9e05720 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055927 Feb 08 16:46:14.615134 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 337/668] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:46:14 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:46:14.817331 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-872e47cf-bc03-4e50-9afa-bb0fdf833d82 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:14.819128 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-872e47cf-bc03-4e50-9afa-bb0fdf833d82 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: c3bef185-a618-44ad-a691-59b9ec1303e8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:14.829472 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-872e47cf-bc03-4e50-9afa-bb0fdf833d82 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:14.829952 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-872e47cf-bc03-4e50-9afa-bb0fdf833d82 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:14.830755 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-872e47cf-bc03-4e50-9afa-bb0fdf833d82 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:14.831189 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-872e47cf-bc03-4e50-9afa-bb0fdf833d82 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:14.879496 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c61ebb5d-6bc3-471a-b857-65e79d140290 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:46:14.889513 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c61ebb5d-6bc3-471a-b857-65e79d140290 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:14.890362 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c61ebb5d-6bc3-471a-b857-65e79d140290 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:15.080884 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c61ebb5d-6bc3-471a-b857-65e79d140290 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Going to try to stop instance {{(pid=122902) force_stop /opt/stack/nova/nova/compute/api.py:2655}} Feb 08 16:46:15.190743 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-872e47cf-bc03-4e50-9afa-bb0fdf833d82 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:15.193995 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c61ebb5d-6bc3-471a-b857-65e79d140290 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "POST /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764/action" status: 202 len: 0 microversion: 2.1 time: 0.320018 Feb 08 16:46:15.195340 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 338/669] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Feb 8 16:46:14 2022] POST /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:46:15.205071 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-52765fbb-ea4d-4fc7-99a4-9910230cf6f5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:15.206178 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-52765fbb-ea4d-4fc7-99a4-9910230cf6f5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:15.214547 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-872e47cf-bc03-4e50-9afa-bb0fdf833d82 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8" status: 200 len: 1319 microversion: 2.1 time: 0.402931 Feb 08 16:46:15.215462 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 332/670] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:14 2022] GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8 => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:15.221927 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-52765fbb-ea4d-4fc7-99a4-9910230cf6f5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:15.222824 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-52765fbb-ea4d-4fc7-99a4-9910230cf6f5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:15.226736 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-52765fbb-ea4d-4fc7-99a4-9910230cf6f5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:15.227738 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-52765fbb-ea4d-4fc7-99a4-9910230cf6f5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:15.231670 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ed3495a4-d2e1-4d4c-895c-6fabb57a65c6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:15.234457 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-ed3495a4-d2e1-4d4c-895c-6fabb57a65c6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:15.252427 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ed3495a4-d2e1-4d4c-895c-6fabb57a65c6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:15.253748 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ed3495a4-d2e1-4d4c-895c-6fabb57a65c6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:15.254580 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ed3495a4-d2e1-4d4c-895c-6fabb57a65c6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:15.255002 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ed3495a4-d2e1-4d4c-895c-6fabb57a65c6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:15.586657 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-52765fbb-ea4d-4fc7-99a4-9910230cf6f5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:15.603149 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-52765fbb-ea4d-4fc7-99a4-9910230cf6f5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1724 microversion: 2.1 time: 0.402301 Feb 08 16:46:15.610125 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 339/671] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:15 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1724 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:15.622482 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-9d99efe5-0a2e-4a82-a053-3e087ef4d57d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:15.624256 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-9d99efe5-0a2e-4a82-a053-3e087ef4d57d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:15.632569 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9d99efe5-0a2e-4a82-a053-3e087ef4d57d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:15.633273 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9d99efe5-0a2e-4a82-a053-3e087ef4d57d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:15.635530 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9d99efe5-0a2e-4a82-a053-3e087ef4d57d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:15.636444 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9d99efe5-0a2e-4a82-a053-3e087ef4d57d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:15.654047 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ed3495a4-d2e1-4d4c-895c-6fabb57a65c6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:15.664159 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ed3495a4-d2e1-4d4c-895c-6fabb57a65c6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:15.668634 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ed3495a4-d2e1-4d4c-895c-6fabb57a65c6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:15.672328 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-ed3495a4-d2e1-4d4c-895c-6fabb57a65c6 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1722 microversion: 2.20 time: 0.445328 Feb 08 16:46:15.675266 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 333/672] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:15 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1722 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:46:15.677745 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-9d99efe5-0a2e-4a82-a053-3e087ef4d57d tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059045 Feb 08 16:46:15.678795 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 340/673] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:46:15 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 08 16:46:16.235149 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-44904175-48d4-4e0b-8e39-e0d4ef8c3e02 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:16.237565 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-44904175-48d4-4e0b-8e39-e0d4ef8c3e02 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: c3bef185-a618-44ad-a691-59b9ec1303e8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:16.244350 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-44904175-48d4-4e0b-8e39-e0d4ef8c3e02 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:16.245350 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-44904175-48d4-4e0b-8e39-e0d4ef8c3e02 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:16.246622 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-44904175-48d4-4e0b-8e39-e0d4ef8c3e02 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:16.247420 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-44904175-48d4-4e0b-8e39-e0d4ef8c3e02 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:16.484217 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-44904175-48d4-4e0b-8e39-e0d4ef8c3e02 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:16.494800 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-44904175-48d4-4e0b-8e39-e0d4ef8c3e02 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8" status: 200 len: 1319 microversion: 2.1 time: 0.264812 Feb 08 16:46:16.496089 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 334/674] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:16 2022] GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:16.620766 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-0ba30fb0-6012-4c80-984c-f9ae90eb64ba tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:16.621376 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-0ba30fb0-6012-4c80-984c-f9ae90eb64ba tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:16.627871 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0ba30fb0-6012-4c80-984c-f9ae90eb64ba tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:16.628579 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0ba30fb0-6012-4c80-984c-f9ae90eb64ba tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:16.629568 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0ba30fb0-6012-4c80-984c-f9ae90eb64ba tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:16.630190 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0ba30fb0-6012-4c80-984c-f9ae90eb64ba tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:16.694475 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-db608ba7-f4d1-4739-97cb-b12a5b2896cc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:16.695203 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-db608ba7-f4d1-4739-97cb-b12a5b2896cc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:16.702288 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-db608ba7-f4d1-4739-97cb-b12a5b2896cc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:16.703223 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-db608ba7-f4d1-4739-97cb-b12a5b2896cc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:16.704318 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-db608ba7-f4d1-4739-97cb-b12a5b2896cc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:16.705005 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-db608ba7-f4d1-4739-97cb-b12a5b2896cc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:16.901326 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-db608ba7-f4d1-4739-97cb-b12a5b2896cc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:16.913076 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-db608ba7-f4d1-4739-97cb-b12a5b2896cc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:16.914569 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-db608ba7-f4d1-4739-97cb-b12a5b2896cc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:16.916590 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-db608ba7-f4d1-4739-97cb-b12a5b2896cc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1722 microversion: 2.20 time: 0.226110 Feb 08 16:46:16.918688 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 335/675] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:16 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:46:16.944570 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-184b19a7-e259-4365-a3db-178612df2cf0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:16.945153 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-184b19a7-e259-4365-a3db-178612df2cf0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:16.952393 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-184b19a7-e259-4365-a3db-178612df2cf0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:16.956264 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-184b19a7-e259-4365-a3db-178612df2cf0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:16.957325 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-184b19a7-e259-4365-a3db-178612df2cf0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:16.957791 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-184b19a7-e259-4365-a3db-178612df2cf0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:16.999333 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-184b19a7-e259-4365-a3db-178612df2cf0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Going to try to terminate instance {{(pid=122901) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 16:46:17.115105 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-184b19a7-e259-4365-a3db-178612df2cf0 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "DELETE /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 204 len: 0 microversion: 2.1 time: 0.173306 Feb 08 16:46:17.116320 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 336/676] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Feb 8 16:46:16 2022] DELETE /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 16:46:17.129263 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-1fc1f281-9810-426d-b7f4-8251a3ab34a7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:17.130439 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-1fc1f281-9810-426d-b7f4-8251a3ab34a7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:17.139498 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1fc1f281-9810-426d-b7f4-8251a3ab34a7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:17.140318 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1fc1f281-9810-426d-b7f4-8251a3ab34a7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:17.141398 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1fc1f281-9810-426d-b7f4-8251a3ab34a7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:17.142217 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1fc1f281-9810-426d-b7f4-8251a3ab34a7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:17.188340 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-0ba30fb0-6012-4c80-984c-f9ae90eb64ba tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:17.216526 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-0ba30fb0-6012-4c80-984c-f9ae90eb64ba tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1724 microversion: 2.1 time: 0.599296 Feb 08 16:46:17.219172 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 341/677] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:16 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1724 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:17.342060 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-1fc1f281-9810-426d-b7f4-8251a3ab34a7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:17.352262 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-1fc1f281-9810-426d-b7f4-8251a3ab34a7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1514 microversion: 2.1 time: 0.230037 Feb 08 16:46:17.367190 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 337/678] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:17 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:17.515021 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-0fcd7046-328f-4083-9d85-f2c4db436734 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:17.515949 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-0fcd7046-328f-4083-9d85-f2c4db436734 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: c3bef185-a618-44ad-a691-59b9ec1303e8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:17.523595 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0fcd7046-328f-4083-9d85-f2c4db436734 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:17.524075 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0fcd7046-328f-4083-9d85-f2c4db436734 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:17.525421 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0fcd7046-328f-4083-9d85-f2c4db436734 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:17.525861 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0fcd7046-328f-4083-9d85-f2c4db436734 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:17.821421 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-0fcd7046-328f-4083-9d85-f2c4db436734 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:17.832691 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-0fcd7046-328f-4083-9d85-f2c4db436734 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8" status: 200 len: 1319 microversion: 2.1 time: 0.321761 Feb 08 16:46:17.833654 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 342/679] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:17 2022] GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8 => generated 1319 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:17.880344 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-12520a41-f8e9-49b8-bd5f-15bf0f3c7bd4 req-98650697-3471-4b4a-9edb-b15d2c7d5ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3bef185-a618-44ad-a691-59b9ec1303e8", "name": "network-vif-plugged", "status": "completed", "tag": "caf61fd0-7dff-4794-942a-dd5f8ce46e23"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:46:17.882390 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:46:17.882390 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:46:17.896652 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-12520a41-f8e9-49b8-bd5f-15bf0f3c7bd4 req-98650697-3471-4b4a-9edb-b15d2c7d5ab0 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:17.901392 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-12520a41-f8e9-49b8-bd5f-15bf0f3c7bd4 req-98650697-3471-4b4a-9edb-b15d2c7d5ab0 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:17.934706 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-12520a41-f8e9-49b8-bd5f-15bf0f3c7bd4 req-98650697-3471-4b4a-9edb-b15d2c7d5ab0 service nova] Creating event network-vif-plugged:caf61fd0-7dff-4794-942a-dd5f8ce46e23 for instance c3bef185-a618-44ad-a691-59b9ec1303e8 on hv-cinder-82786 Feb 08 16:46:17.937374 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-eff8caba-5d6b-421d-b706-c30c9695855c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:17.942508 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-eff8caba-5d6b-421d-b706-c30c9695855c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:17.948426 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-12520a41-f8e9-49b8-bd5f-15bf0f3c7bd4 req-98650697-3471-4b4a-9edb-b15d2c7d5ab0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072490 Feb 08 16:46:17.952001 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 338/680] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:46:17.987811 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eff8caba-5d6b-421d-b706-c30c9695855c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:17.988506 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eff8caba-5d6b-421d-b706-c30c9695855c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:18.000474 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eff8caba-5d6b-421d-b706-c30c9695855c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:18.002024 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eff8caba-5d6b-421d-b706-c30c9695855c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:18.261313 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-937a59cb-3825-4cd6-a3c2-4d36b13ae8ec tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:18.262357 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-937a59cb-3825-4cd6-a3c2-4d36b13ae8ec tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:18.296308 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-937a59cb-3825-4cd6-a3c2-4d36b13ae8ec tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:18.298269 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-937a59cb-3825-4cd6-a3c2-4d36b13ae8ec tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:18.303689 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-937a59cb-3825-4cd6-a3c2-4d36b13ae8ec tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:18.304488 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-937a59cb-3825-4cd6-a3c2-4d36b13ae8ec tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:18.560525 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-937a59cb-3825-4cd6-a3c2-4d36b13ae8ec tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:18.588254 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-937a59cb-3825-4cd6-a3c2-4d36b13ae8ec tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1724 microversion: 2.1 time: 0.353913 Feb 08 16:46:18.599352 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 339/681] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:18 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1724 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:18.606073 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-7dbcc5e9-3638-44da-84d8-4daf7451b339 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:18.607242 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7dbcc5e9-3638-44da-84d8-4daf7451b339 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:18.615560 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7dbcc5e9-3638-44da-84d8-4daf7451b339 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:18.616353 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7dbcc5e9-3638-44da-84d8-4daf7451b339 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:18.618062 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7dbcc5e9-3638-44da-84d8-4daf7451b339 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:18.619084 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7dbcc5e9-3638-44da-84d8-4daf7451b339 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:18.722338 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-eff8caba-5d6b-421d-b706-c30c9695855c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:18.735981 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-eff8caba-5d6b-421d-b706-c30c9695855c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:18.740938 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-eff8caba-5d6b-421d-b706-c30c9695855c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:18.744038 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-eff8caba-5d6b-421d-b706-c30c9695855c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1722 microversion: 2.20 time: 0.812828 Feb 08 16:46:18.747489 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 343/682] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:17 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1722 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:18.854884 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-884dfc23-62bf-4c73-b43b-1c5cc6462616 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:18.857019 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-884dfc23-62bf-4c73-b43b-1c5cc6462616 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: c3bef185-a618-44ad-a691-59b9ec1303e8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:18.867436 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-884dfc23-62bf-4c73-b43b-1c5cc6462616 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:18.868389 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-884dfc23-62bf-4c73-b43b-1c5cc6462616 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:18.888280 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-884dfc23-62bf-4c73-b43b-1c5cc6462616 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:18.889932 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-884dfc23-62bf-4c73-b43b-1c5cc6462616 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:18.928668 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7dbcc5e9-3638-44da-84d8-4daf7451b339 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:18.939044 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-7dbcc5e9-3638-44da-84d8-4daf7451b339 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1514 microversion: 2.1 time: 0.337908 Feb 08 16:46:18.939639 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 340/683] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:18 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1514 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:19.271054 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-884dfc23-62bf-4c73-b43b-1c5cc6462616 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:19.279413 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-884dfc23-62bf-4c73-b43b-1c5cc6462616 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8" status: 200 len: 1319 microversion: 2.1 time: 0.432188 Feb 08 16:46:19.287705 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 344/684] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:18 2022] GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8 => generated 1319 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:19.606099 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-a357c972-27ed-48e8-a7db-2d79549fa39f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:19.606720 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-a357c972-27ed-48e8-a7db-2d79549fa39f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:19.621350 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a357c972-27ed-48e8-a7db-2d79549fa39f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:19.621814 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a357c972-27ed-48e8-a7db-2d79549fa39f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:19.622636 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a357c972-27ed-48e8-a7db-2d79549fa39f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:19.623078 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a357c972-27ed-48e8-a7db-2d79549fa39f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:19.764254 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c4c4cf33-9862-483c-a357-d590436f2130 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:19.765328 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c4c4cf33-9862-483c-a357-d590436f2130 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:19.772297 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c4c4cf33-9862-483c-a357-d590436f2130 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:19.773055 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c4c4cf33-9862-483c-a357-d590436f2130 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:19.774038 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c4c4cf33-9862-483c-a357-d590436f2130 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:19.775364 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c4c4cf33-9862-483c-a357-d590436f2130 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:19.967061 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c4c4cf33-9862-483c-a357-d590436f2130 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:19.976620 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c4c4cf33-9862-483c-a357-d590436f2130 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:19.992690 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c4c4cf33-9862-483c-a357-d590436f2130 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:20.002894 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c4c4cf33-9862-483c-a357-d590436f2130 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1722 microversion: 2.20 time: 0.241961 Feb 08 16:46:20.017973 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 345/685] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:19 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:46:20.024335 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-fc74d7fb-e5d3-4eed-b9d6-bd7a26b2efa2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:20.025549 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-fc74d7fb-e5d3-4eed-b9d6-bd7a26b2efa2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:20.036017 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fc74d7fb-e5d3-4eed-b9d6-bd7a26b2efa2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:20.036555 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fc74d7fb-e5d3-4eed-b9d6-bd7a26b2efa2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:20.038452 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fc74d7fb-e5d3-4eed-b9d6-bd7a26b2efa2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:20.039155 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fc74d7fb-e5d3-4eed-b9d6-bd7a26b2efa2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:20.345749 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-fc74d7fb-e5d3-4eed-b9d6-bd7a26b2efa2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:20.357054 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-fc74d7fb-e5d3-4eed-b9d6-bd7a26b2efa2 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1514 microversion: 2.1 time: 0.337650 Feb 08 16:46:20.357648 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 346/686] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:20 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1514 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:20.380799 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b18127e8-7c08-451d-8499-4ebc602c7d10 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:20.381727 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b18127e8-7c08-451d-8499-4ebc602c7d10 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: c3bef185-a618-44ad-a691-59b9ec1303e8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:20.395288 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b18127e8-7c08-451d-8499-4ebc602c7d10 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:20.396036 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b18127e8-7c08-451d-8499-4ebc602c7d10 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:20.397085 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b18127e8-7c08-451d-8499-4ebc602c7d10 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:20.397732 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b18127e8-7c08-451d-8499-4ebc602c7d10 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:20.500218 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-a357c972-27ed-48e8-a7db-2d79549fa39f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:20.508302 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-a357c972-27ed-48e8-a7db-2d79549fa39f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1724 microversion: 2.1 time: 0.906115 Feb 08 16:46:20.509950 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 341/687] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:19 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1724 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:20.773443 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b18127e8-7c08-451d-8499-4ebc602c7d10 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:20.782815 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b18127e8-7c08-451d-8499-4ebc602c7d10 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8" status: 200 len: 1319 microversion: 2.1 time: 0.405607 Feb 08 16:46:20.795424 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 347/688] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:20 2022] GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8 => generated 1319 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:20.966956 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-03d9c67e-ccb0-482a-8202-298ba9c81cce req-11d69f03-d59b-4e3a-a0db-37d278b94e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f35dcea-496c-4068-8519-33560beb7168", "name": "network-vif-deleted", "tag": "c3b70171-ae78-4aa2-9269-f259a579efd6"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:46:20.969284 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:46:20.969284 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:46:20.995032 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-03d9c67e-ccb0-482a-8202-298ba9c81cce req-11d69f03-d59b-4e3a-a0db-37d278b94e9e service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:20.995784 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-03d9c67e-ccb0-482a-8202-298ba9c81cce req-11d69f03-d59b-4e3a-a0db-37d278b94e9e service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:21.022432 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-1b949773-5e23-4ef0-af9d-63472c2975b2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:21.023699 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-1b949773-5e23-4ef0-af9d-63472c2975b2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:21.030888 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-03d9c67e-ccb0-482a-8202-298ba9c81cce req-11d69f03-d59b-4e3a-a0db-37d278b94e9e service nova] Creating event network-vif-deleted:c3b70171-ae78-4aa2-9269-f259a579efd6 for instance 2f35dcea-496c-4068-8519-33560beb7168 on hv-cinder-82786 Feb 08 16:46:21.034179 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1b949773-5e23-4ef0-af9d-63472c2975b2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:21.034933 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1b949773-5e23-4ef0-af9d-63472c2975b2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:21.036646 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1b949773-5e23-4ef0-af9d-63472c2975b2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:21.038092 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1b949773-5e23-4ef0-af9d-63472c2975b2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:21.045528 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-03d9c67e-ccb0-482a-8202-298ba9c81cce req-11d69f03-d59b-4e3a-a0db-37d278b94e9e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083135 Feb 08 16:46:21.046428 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 342/689] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:46:21.228809 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-1b949773-5e23-4ef0-af9d-63472c2975b2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:21.237576 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-1b949773-5e23-4ef0-af9d-63472c2975b2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:21.239522 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-1b949773-5e23-4ef0-af9d-63472c2975b2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:21.240993 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-1b949773-5e23-4ef0-af9d-63472c2975b2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1722 microversion: 2.20 time: 0.222365 Feb 08 16:46:21.242122 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 348/690] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:21 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:46:21.374805 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-138f072e-4293-4744-ac56-eb36f56cbc89 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:21.375884 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-138f072e-4293-4744-ac56-eb36f56cbc89 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:21.388750 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-138f072e-4293-4744-ac56-eb36f56cbc89 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:21.389554 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-138f072e-4293-4744-ac56-eb36f56cbc89 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:21.390601 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-138f072e-4293-4744-ac56-eb36f56cbc89 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:21.391310 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-138f072e-4293-4744-ac56-eb36f56cbc89 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:21.436558 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-138f072e-4293-4744-ac56-eb36f56cbc89 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:21.437420 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-138f072e-4293-4744-ac56-eb36f56cbc89 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:21.437878 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.objects.instance [None req-138f072e-4293-4744-ac56-eb36f56cbc89 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lazy-loading 'fault' on Instance uuid 2f35dcea-496c-4068-8519-33560beb7168 {{(pid=122901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:46:21.494427 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-138f072e-4293-4744-ac56-eb36f56cbc89 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:21.507791 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-138f072e-4293-4744-ac56-eb36f56cbc89 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 200 len: 1307 microversion: 2.1 time: 0.137661 Feb 08 16:46:21.523693 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 343/691] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:21 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 1307 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:21.526679 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e0d236d9-668a-4833-a1ef-0d63d37ea376 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:21.527293 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e0d236d9-668a-4833-a1ef-0d63d37ea376 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:21.535176 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e0d236d9-668a-4833-a1ef-0d63d37ea376 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:21.535176 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e0d236d9-668a-4833-a1ef-0d63d37ea376 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:21.535651 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e0d236d9-668a-4833-a1ef-0d63d37ea376 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:21.536122 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e0d236d9-668a-4833-a1ef-0d63d37ea376 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:21.690106 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e0d236d9-668a-4833-a1ef-0d63d37ea376 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:21.701439 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e0d236d9-668a-4833-a1ef-0d63d37ea376 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1724 microversion: 2.1 time: 0.179023 Feb 08 16:46:21.702744 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 349/692] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:21 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:21.800233 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-4e083e00-2870-4a25-83dd-982732813c15 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:21.801559 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4e083e00-2870-4a25-83dd-982732813c15 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: c3bef185-a618-44ad-a691-59b9ec1303e8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:21.808260 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4e083e00-2870-4a25-83dd-982732813c15 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:21.809025 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4e083e00-2870-4a25-83dd-982732813c15 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:21.810283 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4e083e00-2870-4a25-83dd-982732813c15 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:21.810716 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4e083e00-2870-4a25-83dd-982732813c15 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:22.086603 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4e083e00-2870-4a25-83dd-982732813c15 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:22.102484 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-4e083e00-2870-4a25-83dd-982732813c15 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8" status: 200 len: 1509 microversion: 2.1 time: 0.305608 Feb 08 16:46:22.114346 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 344/693] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:21 2022] GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8 => generated 1509 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:22.119666 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-64272a56-9089-4712-9d45-d5e4873bfb32 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48e675f0-8ca7-4d15-803b-70a6d058c6a3", "device": "/dev/sdb"}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:46:22.121916 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-64272a56-9089-4712-9d45-d5e4873bfb32 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: c3bef185-a618-44ad-a691-59b9ec1303e8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:22.129158 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-64272a56-9089-4712-9d45-d5e4873bfb32 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:22.129873 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-64272a56-9089-4712-9d45-d5e4873bfb32 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:22.130856 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-64272a56-9089-4712-9d45-d5e4873bfb32 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:22.131455 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-64272a56-9089-4712-9d45-d5e4873bfb32 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:22.265363 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-135c3f4d-828e-4f12-862a-5cbe1519a233 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:22.266190 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-135c3f4d-828e-4f12-862a-5cbe1519a233 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:22.277555 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-135c3f4d-828e-4f12-862a-5cbe1519a233 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:22.281949 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-135c3f4d-828e-4f12-862a-5cbe1519a233 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:22.283851 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-135c3f4d-828e-4f12-862a-5cbe1519a233 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:22.284474 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-135c3f4d-828e-4f12-862a-5cbe1519a233 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:22.485914 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-64272a56-9089-4712-9d45-d5e4873bfb32 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "POST /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.370230 Feb 08 16:46:22.487038 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 350/694] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Feb 8 16:46:22 2022] POST /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8/os-volume_attachments => generated 194 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:46:22.532402 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-4bd90819-f35b-41bd-8147-468511d080c1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:22.533410 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-4bd90819-f35b-41bd-8147-468511d080c1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 2f35dcea-496c-4068-8519-33560beb7168] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:22.552977 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4bd90819-f35b-41bd-8147-468511d080c1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:22.554512 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4bd90819-f35b-41bd-8147-468511d080c1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:22.558758 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-135c3f4d-828e-4f12-862a-5cbe1519a233 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:22.558971 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4bd90819-f35b-41bd-8147-468511d080c1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:22.561145 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4bd90819-f35b-41bd-8147-468511d080c1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:22.569777 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-135c3f4d-828e-4f12-862a-5cbe1519a233 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:22.578446 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-135c3f4d-828e-4f12-862a-5cbe1519a233 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:22.581508 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-135c3f4d-828e-4f12-862a-5cbe1519a233 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1722 microversion: 2.20 time: 0.324681 Feb 08 16:46:22.582958 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 345/695] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:22 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1722 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:22.630972 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-4bd90819-f35b-41bd-8147-468511d080c1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] HTTP exception thrown: Instance 2f35dcea-496c-4068-8519-33560beb7168 could not be found. Feb 08 16:46:22.631770 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-4bd90819-f35b-41bd-8147-468511d080c1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Returning 404 to user: Instance 2f35dcea-496c-4068-8519-33560beb7168 could not be found. {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:46:22.632643 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-4bd90819-f35b-41bd-8147-468511d080c1 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168" status: 404 len: 111 microversion: 2.1 time: 0.111064 Feb 08 16:46:22.638331 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 351/696] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:22 2022] GET /compute/v2.1/servers/2f35dcea-496c-4068-8519-33560beb7168 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:46:22.719716 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-8140a4df-190a-46c4-8ba7-bce759239104 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:22.720491 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-8140a4df-190a-46c4-8ba7-bce759239104 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:22.736963 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8140a4df-190a-46c4-8ba7-bce759239104 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:22.737492 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8140a4df-190a-46c4-8ba7-bce759239104 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:22.741813 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8140a4df-190a-46c4-8ba7-bce759239104 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:22.742482 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8140a4df-190a-46c4-8ba7-bce759239104 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:22.969810 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-8140a4df-190a-46c4-8ba7-bce759239104 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:22.978688 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-8140a4df-190a-46c4-8ba7-bce759239104 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1724 microversion: 2.1 time: 0.262331 Feb 08 16:46:22.980456 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 346/697] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:22 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:23.612329 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-6d3c0aad-1538-47c7-908f-9b17e97124a0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:23.612970 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-6d3c0aad-1538-47c7-908f-9b17e97124a0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:23.641839 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6d3c0aad-1538-47c7-908f-9b17e97124a0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:23.642395 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6d3c0aad-1538-47c7-908f-9b17e97124a0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:23.654477 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6d3c0aad-1538-47c7-908f-9b17e97124a0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:23.654477 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6d3c0aad-1538-47c7-908f-9b17e97124a0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:23.852433 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-72d635b8-3670-4e85-9d1a-e4069fb13ff3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:23.853622 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-72d635b8-3670-4e85-9d1a-e4069fb13ff3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:23.866766 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-72d635b8-3670-4e85-9d1a-e4069fb13ff3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:23.868316 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-72d635b8-3670-4e85-9d1a-e4069fb13ff3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:23.869288 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-72d635b8-3670-4e85-9d1a-e4069fb13ff3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:23.871724 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-72d635b8-3670-4e85-9d1a-e4069fb13ff3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:23.943649 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-72d635b8-3670-4e85-9d1a-e4069fb13ff3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Going to try to terminate instance {{(pid=122901) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 16:46:23.975405 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-6d3c0aad-1538-47c7-908f-9b17e97124a0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:23.984571 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-6d3c0aad-1538-47c7-908f-9b17e97124a0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:23.986080 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-6d3c0aad-1538-47c7-908f-9b17e97124a0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:23.987270 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-6d3c0aad-1538-47c7-908f-9b17e97124a0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1743 microversion: 2.20 time: 0.391254 Feb 08 16:46:24.006790 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 352/698] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:23 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1743 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:24.007348 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-7fededd2-2768-4c7f-8cab-6ed325ab11d3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:24.007560 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-7fededd2-2768-4c7f-8cab-6ed325ab11d3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:24.021885 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7fededd2-2768-4c7f-8cab-6ed325ab11d3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:24.022813 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7fededd2-2768-4c7f-8cab-6ed325ab11d3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:24.023837 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7fededd2-2768-4c7f-8cab-6ed325ab11d3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:24.025912 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7fededd2-2768-4c7f-8cab-6ed325ab11d3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:24.135163 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-72d635b8-3670-4e85-9d1a-e4069fb13ff3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 204 len: 0 microversion: 2.1 time: 0.286054 Feb 08 16:46:24.136345 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 347/699] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Feb 8 16:46:23 2022] DELETE /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 08 16:46:24.149369 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-35b3d1dc-5cdb-4a7f-8f50-32533af7bbff tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:24.152376 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-35b3d1dc-5cdb-4a7f-8f50-32533af7bbff tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:24.162630 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-35b3d1dc-5cdb-4a7f-8f50-32533af7bbff tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:24.168379 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-35b3d1dc-5cdb-4a7f-8f50-32533af7bbff tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:24.169859 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-35b3d1dc-5cdb-4a7f-8f50-32533af7bbff tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:24.170659 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-35b3d1dc-5cdb-4a7f-8f50-32533af7bbff tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:24.346401 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-7fededd2-2768-4c7f-8cab-6ed325ab11d3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:24.357108 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-7fededd2-2768-4c7f-8cab-6ed325ab11d3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1724 microversion: 2.1 time: 0.358667 Feb 08 16:46:24.358426 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 353/700] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:23 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1724 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:24.445058 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-35b3d1dc-5cdb-4a7f-8f50-32533af7bbff tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:24.454233 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-35b3d1dc-5cdb-4a7f-8f50-32533af7bbff tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1513 microversion: 2.1 time: 0.312065 Feb 08 16:46:24.455739 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 348/701] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:24 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1513 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:25.014937 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-3f8495ab-22d1-4816-b30e-c0b78a313003 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:25.016933 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-3f8495ab-22d1-4816-b30e-c0b78a313003 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:25.027284 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3f8495ab-22d1-4816-b30e-c0b78a313003 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:25.028046 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3f8495ab-22d1-4816-b30e-c0b78a313003 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:25.029577 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3f8495ab-22d1-4816-b30e-c0b78a313003 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:25.030326 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3f8495ab-22d1-4816-b30e-c0b78a313003 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:25.205654 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3f8495ab-22d1-4816-b30e-c0b78a313003 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:25.216816 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3f8495ab-22d1-4816-b30e-c0b78a313003 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:25.220123 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3f8495ab-22d1-4816-b30e-c0b78a313003 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:25.221612 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-3f8495ab-22d1-4816-b30e-c0b78a313003 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1743 microversion: 2.20 time: 0.211261 Feb 08 16:46:25.222184 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 354/702] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:25 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1743 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:46:25.374876 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-43c890e7-f5c9-4326-aa82-32820f1a7045 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:25.376334 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-43c890e7-f5c9-4326-aa82-32820f1a7045 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:25.388666 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-43c890e7-f5c9-4326-aa82-32820f1a7045 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:25.389242 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-43c890e7-f5c9-4326-aa82-32820f1a7045 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:25.390100 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-43c890e7-f5c9-4326-aa82-32820f1a7045 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:25.390548 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-43c890e7-f5c9-4326-aa82-32820f1a7045 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:25.475584 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-3a4367aa-ea5a-4a3d-ad76-97dd873f4850 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:25.476445 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-3a4367aa-ea5a-4a3d-ad76-97dd873f4850 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:25.483219 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3a4367aa-ea5a-4a3d-ad76-97dd873f4850 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:25.483830 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3a4367aa-ea5a-4a3d-ad76-97dd873f4850 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:25.484995 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3a4367aa-ea5a-4a3d-ad76-97dd873f4850 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:25.485567 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3a4367aa-ea5a-4a3d-ad76-97dd873f4850 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:25.591684 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-43c890e7-f5c9-4326-aa82-32820f1a7045 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:25.601804 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-43c890e7-f5c9-4326-aa82-32820f1a7045 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1724 microversion: 2.1 time: 0.229144 Feb 08 16:46:25.603799 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 349/703] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:25 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:25.708419 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3a4367aa-ea5a-4a3d-ad76-97dd873f4850 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:25.716563 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-3a4367aa-ea5a-4a3d-ad76-97dd873f4850 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1513 microversion: 2.1 time: 0.244812 Feb 08 16:46:25.718009 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 355/704] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:25 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1513 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:25.860224 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-af456866-3b37-4054-aef1-910edb66a77d req-9c4963bb-411d-42a7-a1b4-2c696e3eef27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da00c476-8246-413e-889c-d22fe63e2ef8", "name": "network-vif-plugged", "status": "completed", "tag": "dc601835-5363-4bdf-9b05-9e711057cbd2"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:46:25.861946 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:46:25.861946 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:46:25.871667 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-af456866-3b37-4054-aef1-910edb66a77d req-9c4963bb-411d-42a7-a1b4-2c696e3eef27 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:25.881822 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-af456866-3b37-4054-aef1-910edb66a77d req-9c4963bb-411d-42a7-a1b4-2c696e3eef27 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:25.897324 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-af456866-3b37-4054-aef1-910edb66a77d req-9c4963bb-411d-42a7-a1b4-2c696e3eef27 service nova] Creating event network-vif-plugged:dc601835-5363-4bdf-9b05-9e711057cbd2 for instance da00c476-8246-413e-889c-d22fe63e2ef8 on hv-cinder-82786 Feb 08 16:46:25.903434 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-af456866-3b37-4054-aef1-910edb66a77d req-9c4963bb-411d-42a7-a1b4-2c696e3eef27 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052832 Feb 08 16:46:25.904648 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 350/705] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:46:26.245786 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-3993a139-8b88-4be8-aa92-8a094b560982 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:26.246389 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-3993a139-8b88-4be8-aa92-8a094b560982 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:26.255407 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3993a139-8b88-4be8-aa92-8a094b560982 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:26.255890 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3993a139-8b88-4be8-aa92-8a094b560982 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:26.257011 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3993a139-8b88-4be8-aa92-8a094b560982 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:26.257686 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3993a139-8b88-4be8-aa92-8a094b560982 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:26.451137 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3993a139-8b88-4be8-aa92-8a094b560982 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:26.461075 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3993a139-8b88-4be8-aa92-8a094b560982 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:26.465488 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3993a139-8b88-4be8-aa92-8a094b560982 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:26.466934 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-3993a139-8b88-4be8-aa92-8a094b560982 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1743 microversion: 2.20 time: 0.225686 Feb 08 16:46:26.476432 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 356/706] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:26 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1743 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:26.621353 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-0d3dbb60-3b98-487e-961a-faf6341fad39 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:26.622092 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-0d3dbb60-3b98-487e-961a-faf6341fad39 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:26.646363 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0d3dbb60-3b98-487e-961a-faf6341fad39 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:26.650205 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0d3dbb60-3b98-487e-961a-faf6341fad39 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:26.651333 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0d3dbb60-3b98-487e-961a-faf6341fad39 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:26.651966 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0d3dbb60-3b98-487e-961a-faf6341fad39 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:26.734255 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-51a0e8b5-a10d-49e8-bc6f-5360001a5580 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:26.735132 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-51a0e8b5-a10d-49e8-bc6f-5360001a5580 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:26.741961 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-51a0e8b5-a10d-49e8-bc6f-5360001a5580 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:26.746842 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-51a0e8b5-a10d-49e8-bc6f-5360001a5580 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:26.751081 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-51a0e8b5-a10d-49e8-bc6f-5360001a5580 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:26.751709 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-51a0e8b5-a10d-49e8-bc6f-5360001a5580 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:26.865472 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0d3dbb60-3b98-487e-961a-faf6341fad39 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:26.874320 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-0d3dbb60-3b98-487e-961a-faf6341fad39 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1724 microversion: 2.1 time: 0.258560 Feb 08 16:46:26.876744 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 351/707] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:26 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:27.015967 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-51a0e8b5-a10d-49e8-bc6f-5360001a5580 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:27.023974 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-51a0e8b5-a10d-49e8-bc6f-5360001a5580 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1513 microversion: 2.1 time: 0.293725 Feb 08 16:46:27.036110 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 357/708] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:26 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1513 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:27.488395 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-71f2f3d0-ed4d-4ae4-9bfb-4fce0f5c3167 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:27.489005 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-71f2f3d0-ed4d-4ae4-9bfb-4fce0f5c3167 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:27.500643 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-71f2f3d0-ed4d-4ae4-9bfb-4fce0f5c3167 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:27.501093 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-71f2f3d0-ed4d-4ae4-9bfb-4fce0f5c3167 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:27.504140 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-71f2f3d0-ed4d-4ae4-9bfb-4fce0f5c3167 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:27.504616 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-71f2f3d0-ed4d-4ae4-9bfb-4fce0f5c3167 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:27.743932 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-71f2f3d0-ed4d-4ae4-9bfb-4fce0f5c3167 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:27.763080 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-71f2f3d0-ed4d-4ae4-9bfb-4fce0f5c3167 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:27.769051 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-71f2f3d0-ed4d-4ae4-9bfb-4fce0f5c3167 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:27.773739 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-71f2f3d0-ed4d-4ae4-9bfb-4fce0f5c3167 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1743 microversion: 2.20 time: 0.288768 Feb 08 16:46:27.788516 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 352/709] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:27 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1743 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:27.895365 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-ebeb2f60-4903-4296-99e4-abb3d0d0a56f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:27.896091 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-ebeb2f60-4903-4296-99e4-abb3d0d0a56f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:27.904472 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ebeb2f60-4903-4296-99e4-abb3d0d0a56f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:27.904927 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ebeb2f60-4903-4296-99e4-abb3d0d0a56f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:27.905733 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ebeb2f60-4903-4296-99e4-abb3d0d0a56f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:27.906167 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ebeb2f60-4903-4296-99e4-abb3d0d0a56f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:27.999492 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-d67a5f5b-c1c4-4c82-842e-12391eb3a820 req-661dee70-45e0-40fc-b2ca-80876b511214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2d6f884-29c3-4149-9eaf-7432f6f92a89", "name": "network-vif-deleted", "tag": "9b9c193c-1cd8-48cc-8cbf-37ead2d5bc3d"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:46:28.001795 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:46:28.001795 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:46:28.021183 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-d67a5f5b-c1c4-4c82-842e-12391eb3a820 req-661dee70-45e0-40fc-b2ca-80876b511214 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:28.022962 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-d67a5f5b-c1c4-4c82-842e-12391eb3a820 req-661dee70-45e0-40fc-b2ca-80876b511214 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:28.057548 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-d67a5f5b-c1c4-4c82-842e-12391eb3a820 req-661dee70-45e0-40fc-b2ca-80876b511214 service nova] Creating event network-vif-deleted:9b9c193c-1cd8-48cc-8cbf-37ead2d5bc3d for instance f2d6f884-29c3-4149-9eaf-7432f6f92a89 on hv-cinder-82786 Feb 08 16:46:28.075983 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-d67a5f5b-c1c4-4c82-842e-12391eb3a820 req-661dee70-45e0-40fc-b2ca-80876b511214 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084475 Feb 08 16:46:28.079276 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 353/710] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:46:28.095877 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-30150640-4f78-4542-a967-9ce9683c906e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:28.096601 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-30150640-4f78-4542-a967-9ce9683c906e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:28.113714 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-30150640-4f78-4542-a967-9ce9683c906e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:28.114172 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-30150640-4f78-4542-a967-9ce9683c906e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:28.119454 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-30150640-4f78-4542-a967-9ce9683c906e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:28.120228 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-30150640-4f78-4542-a967-9ce9683c906e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:28.265474 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-30150640-4f78-4542-a967-9ce9683c906e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:28.273364 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-30150640-4f78-4542-a967-9ce9683c906e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 200 len: 1302 microversion: 2.1 time: 0.192011 Feb 08 16:46:28.277290 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 354/711] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:28 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 1302 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:28.327257 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ebeb2f60-4903-4296-99e4-abb3d0d0a56f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:28.338648 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-ebeb2f60-4903-4296-99e4-abb3d0d0a56f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1724 microversion: 2.1 time: 0.448319 Feb 08 16:46:28.340075 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 358/712] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:27 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1724 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:28.795390 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-21ba19d9-33df-47eb-b076-deba4574475b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:28.800878 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-21ba19d9-33df-47eb-b076-deba4574475b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:28.829844 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-21ba19d9-33df-47eb-b076-deba4574475b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:28.834856 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-21ba19d9-33df-47eb-b076-deba4574475b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:28.835670 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-21ba19d9-33df-47eb-b076-deba4574475b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:28.841812 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-21ba19d9-33df-47eb-b076-deba4574475b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:29.071727 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-21ba19d9-33df-47eb-b076-deba4574475b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:29.082332 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-21ba19d9-33df-47eb-b076-deba4574475b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:29.084150 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-21ba19d9-33df-47eb-b076-deba4574475b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:29.085391 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-21ba19d9-33df-47eb-b076-deba4574475b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1743 microversion: 2.20 time: 0.294246 Feb 08 16:46:29.086031 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 355/713] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:28 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1743 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:29.291815 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-acb10381-d97b-4a56-99fc-c9a77e1303e3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:29.293128 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-acb10381-d97b-4a56-99fc-c9a77e1303e3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: f2d6f884-29c3-4149-9eaf-7432f6f92a89] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:29.301988 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-acb10381-d97b-4a56-99fc-c9a77e1303e3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:29.303188 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-acb10381-d97b-4a56-99fc-c9a77e1303e3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:29.305036 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-acb10381-d97b-4a56-99fc-c9a77e1303e3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:29.306423 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-acb10381-d97b-4a56-99fc-c9a77e1303e3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:29.324987 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-acb10381-d97b-4a56-99fc-c9a77e1303e3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] HTTP exception thrown: Instance f2d6f884-29c3-4149-9eaf-7432f6f92a89 could not be found. Feb 08 16:46:29.325834 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-acb10381-d97b-4a56-99fc-c9a77e1303e3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Returning 404 to user: Instance f2d6f884-29c3-4149-9eaf-7432f6f92a89 could not be found. {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:46:29.326896 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-acb10381-d97b-4a56-99fc-c9a77e1303e3 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89" status: 404 len: 111 microversion: 2.1 time: 0.040514 Feb 08 16:46:29.330633 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 359/714] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:29 2022] GET /compute/v2.1/servers/f2d6f884-29c3-4149-9eaf-7432f6f92a89 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:46:29.335494 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-383b4cad-3efd-43cf-9559-14321d19dc6e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:29.336219 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-383b4cad-3efd-43cf-9559-14321d19dc6e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:29.348516 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-383b4cad-3efd-43cf-9559-14321d19dc6e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:29.349047 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-383b4cad-3efd-43cf-9559-14321d19dc6e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:29.349916 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-383b4cad-3efd-43cf-9559-14321d19dc6e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:29.350423 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-383b4cad-3efd-43cf-9559-14321d19dc6e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:29.356281 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-135c2f59-90da-4576-ae55-565e5124ecac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:29.362131 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-135c2f59-90da-4576-ae55-565e5124ecac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:29.376625 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-135c2f59-90da-4576-ae55-565e5124ecac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:29.377644 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-135c2f59-90da-4576-ae55-565e5124ecac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:29.378814 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-135c2f59-90da-4576-ae55-565e5124ecac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:29.380190 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-135c2f59-90da-4576-ae55-565e5124ecac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:29.419533 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-383b4cad-3efd-43cf-9559-14321d19dc6e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Going to try to terminate instance {{(pid=122901) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 16:46:29.609003 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-383b4cad-3efd-43cf-9559-14321d19dc6e tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "DELETE /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 204 len: 0 microversion: 2.1 time: 0.276762 Feb 08 16:46:29.614348 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 356/715] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Feb 8 16:46:29 2022] DELETE /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 08 16:46:29.622541 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-f714f85b-7cd3-4a56-ad55-4251bb1518d4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:29.623716 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-f714f85b-7cd3-4a56-ad55-4251bb1518d4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:29.632431 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f714f85b-7cd3-4a56-ad55-4251bb1518d4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:29.633494 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f714f85b-7cd3-4a56-ad55-4251bb1518d4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:29.635459 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f714f85b-7cd3-4a56-ad55-4251bb1518d4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:29.636198 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f714f85b-7cd3-4a56-ad55-4251bb1518d4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:29.683360 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-135c2f59-90da-4576-ae55-565e5124ecac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:29.697360 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-135c2f59-90da-4576-ae55-565e5124ecac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1724 microversion: 2.1 time: 0.344239 Feb 08 16:46:29.708342 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 360/716] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:29 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1724 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:29.900875 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f714f85b-7cd3-4a56-ad55-4251bb1518d4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:29.912312 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-f714f85b-7cd3-4a56-ad55-4251bb1518d4 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1514 microversion: 2.1 time: 0.296612 Feb 08 16:46:29.913764 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 357/717] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:29 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1514 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:30.105279 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-3703494b-ad4e-4c9d-ab5a-edb3516c59cd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:30.105891 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-3703494b-ad4e-4c9d-ab5a-edb3516c59cd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:30.113507 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3703494b-ad4e-4c9d-ab5a-edb3516c59cd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:30.114010 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3703494b-ad4e-4c9d-ab5a-edb3516c59cd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:30.114804 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3703494b-ad4e-4c9d-ab5a-edb3516c59cd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:30.115247 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3703494b-ad4e-4c9d-ab5a-edb3516c59cd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:30.577557 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3703494b-ad4e-4c9d-ab5a-edb3516c59cd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:30.608301 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3703494b-ad4e-4c9d-ab5a-edb3516c59cd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:30.613391 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3703494b-ad4e-4c9d-ab5a-edb3516c59cd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:30.619112 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-3703494b-ad4e-4c9d-ab5a-edb3516c59cd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1738 microversion: 2.20 time: 0.516597 Feb 08 16:46:30.622607 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 361/718] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:30 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1738 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:30.735669 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-47eba991-a41c-4d34-9248-af6522512b43 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:30.736637 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-47eba991-a41c-4d34-9248-af6522512b43 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:30.768911 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-47eba991-a41c-4d34-9248-af6522512b43 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:30.771426 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-47eba991-a41c-4d34-9248-af6522512b43 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:30.773536 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-47eba991-a41c-4d34-9248-af6522512b43 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:30.776094 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-47eba991-a41c-4d34-9248-af6522512b43 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:30.931643 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-f0e65d9b-3638-4bbe-8e9c-5fdc602e00c5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:30.932541 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-f0e65d9b-3638-4bbe-8e9c-5fdc602e00c5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:30.950166 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f0e65d9b-3638-4bbe-8e9c-5fdc602e00c5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:30.950971 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f0e65d9b-3638-4bbe-8e9c-5fdc602e00c5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:30.951977 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f0e65d9b-3638-4bbe-8e9c-5fdc602e00c5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:30.952639 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f0e65d9b-3638-4bbe-8e9c-5fdc602e00c5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:31.073993 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-47eba991-a41c-4d34-9248-af6522512b43 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:31.085863 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-47eba991-a41c-4d34-9248-af6522512b43 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1701 microversion: 2.1 time: 0.362998 Feb 08 16:46:31.087328 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 358/719] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:30 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1701 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:31.103490 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-123cfe29-2d48-4b3c-a603-8a41f89daff2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:46:31.128718 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-123cfe29-2d48-4b3c-a603-8a41f89daff2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:31.132384 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-123cfe29-2d48-4b3c-a603-8a41f89daff2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:31.207565 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-f0e65d9b-3638-4bbe-8e9c-5fdc602e00c5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:31.218275 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-f0e65d9b-3638-4bbe-8e9c-5fdc602e00c5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1514 microversion: 2.1 time: 0.291009 Feb 08 16:46:31.219695 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 362/720] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:30 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1514 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:31.251368 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-123cfe29-2d48-4b3c-a603-8a41f89daff2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Going to try to start instance {{(pid=122901) start /opt/stack/nova/nova/compute/api.py:2678}} Feb 08 16:46:31.326425 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-123cfe29-2d48-4b3c-a603-8a41f89daff2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "POST /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764/action" status: 202 len: 0 microversion: 2.1 time: 0.226707 Feb 08 16:46:31.328435 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 359/721] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Feb 8 16:46:31 2022] POST /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:46:31.347898 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-969bcf64-5105-4773-a1b0-eaae7a0a4a6b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:31.355577 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-969bcf64-5105-4773-a1b0-eaae7a0a4a6b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:31.373887 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-969bcf64-5105-4773-a1b0-eaae7a0a4a6b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:31.374498 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-969bcf64-5105-4773-a1b0-eaae7a0a4a6b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:31.376711 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-969bcf64-5105-4773-a1b0-eaae7a0a4a6b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:31.380321 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-969bcf64-5105-4773-a1b0-eaae7a0a4a6b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:31.641260 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-7a3aff6d-a1ab-460e-80b3-dbbe0fe421d3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:31.642092 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7a3aff6d-a1ab-460e-80b3-dbbe0fe421d3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:31.654750 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7a3aff6d-a1ab-460e-80b3-dbbe0fe421d3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:31.659511 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7a3aff6d-a1ab-460e-80b3-dbbe0fe421d3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:31.660532 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7a3aff6d-a1ab-460e-80b3-dbbe0fe421d3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:31.661202 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7a3aff6d-a1ab-460e-80b3-dbbe0fe421d3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:31.762807 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-969bcf64-5105-4773-a1b0-eaae7a0a4a6b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:31.772546 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-969bcf64-5105-4773-a1b0-eaae7a0a4a6b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1710 microversion: 2.1 time: 0.437619 Feb 08 16:46:31.776867 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 363/722] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:31 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1710 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:31.957895 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7a3aff6d-a1ab-460e-80b3-dbbe0fe421d3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:31.969523 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7a3aff6d-a1ab-460e-80b3-dbbe0fe421d3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:31.971279 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7a3aff6d-a1ab-460e-80b3-dbbe0fe421d3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:31.973409 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-7a3aff6d-a1ab-460e-80b3-dbbe0fe421d3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1738 microversion: 2.20 time: 0.336592 Feb 08 16:46:31.974540 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 360/723] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:31 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1738 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:32.236213 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e3ce2506-005c-46f8-9695-c68a0e1103b7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:32.236602 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e3ce2506-005c-46f8-9695-c68a0e1103b7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:32.249286 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e3ce2506-005c-46f8-9695-c68a0e1103b7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:32.249935 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e3ce2506-005c-46f8-9695-c68a0e1103b7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:32.250947 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e3ce2506-005c-46f8-9695-c68a0e1103b7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:32.251587 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e3ce2506-005c-46f8-9695-c68a0e1103b7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:32.794384 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-1c3b96a0-4844-439b-925d-246e80bd48ea tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:32.795901 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-1c3b96a0-4844-439b-925d-246e80bd48ea tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:32.808084 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1c3b96a0-4844-439b-925d-246e80bd48ea tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:32.808912 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1c3b96a0-4844-439b-925d-246e80bd48ea tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:32.824133 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1c3b96a0-4844-439b-925d-246e80bd48ea tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:32.825041 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1c3b96a0-4844-439b-925d-246e80bd48ea tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:32.939789 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e3ce2506-005c-46f8-9695-c68a0e1103b7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:32.948894 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e3ce2506-005c-46f8-9695-c68a0e1103b7 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1514 microversion: 2.1 time: 0.716701 Feb 08 16:46:32.950615 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 364/724] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:32 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1514 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:32.992310 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-3078934d-3ca0-43c0-8735-c9619e1294cb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:32.993704 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-3078934d-3ca0-43c0-8735-c9619e1294cb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:33.008034 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3078934d-3ca0-43c0-8735-c9619e1294cb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:33.009031 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3078934d-3ca0-43c0-8735-c9619e1294cb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:33.010424 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3078934d-3ca0-43c0-8735-c9619e1294cb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:33.010870 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3078934d-3ca0-43c0-8735-c9619e1294cb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:33.074523 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-1c3b96a0-4844-439b-925d-246e80bd48ea tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:33.083992 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-1c3b96a0-4844-439b-925d-246e80bd48ea tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1710 microversion: 2.1 time: 0.294443 Feb 08 16:46:33.084573 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 361/725] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:32 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1710 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:33.325374 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3078934d-3ca0-43c0-8735-c9619e1294cb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:33.334083 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3078934d-3ca0-43c0-8735-c9619e1294cb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:33.336267 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3078934d-3ca0-43c0-8735-c9619e1294cb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:33.337840 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-3078934d-3ca0-43c0-8735-c9619e1294cb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1738 microversion: 2.20 time: 0.349073 Feb 08 16:46:33.338958 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 365/726] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:32 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1738 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:33.965831 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-6f348faf-92d5-441b-9f2d-44e4e30269ee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:33.967004 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-6f348faf-92d5-441b-9f2d-44e4e30269ee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:33.980804 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6f348faf-92d5-441b-9f2d-44e4e30269ee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:33.981454 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6f348faf-92d5-441b-9f2d-44e4e30269ee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:33.982531 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6f348faf-92d5-441b-9f2d-44e4e30269ee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:33.984260 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6f348faf-92d5-441b-9f2d-44e4e30269ee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:34.119696 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-7652cd58-bcbf-4264-9916-406e4cda1115 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:34.121688 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-7652cd58-bcbf-4264-9916-406e4cda1115 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:34.143009 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7652cd58-bcbf-4264-9916-406e4cda1115 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:34.146697 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7652cd58-bcbf-4264-9916-406e4cda1115 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:34.151708 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7652cd58-bcbf-4264-9916-406e4cda1115 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:34.153973 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7652cd58-bcbf-4264-9916-406e4cda1115 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:34.431345 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-7652cd58-bcbf-4264-9916-406e4cda1115 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:34.443500 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-7652cd58-bcbf-4264-9916-406e4cda1115 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1710 microversion: 2.1 time: 0.340705 Feb 08 16:46:34.463349 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 366/727] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:34 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1710 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:34.470168 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-3ccdc673-e25a-43ea-8ba4-7df2577eff22 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:34.471014 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-3ccdc673-e25a-43ea-8ba4-7df2577eff22 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:34.477808 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3ccdc673-e25a-43ea-8ba4-7df2577eff22 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:34.478526 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3ccdc673-e25a-43ea-8ba4-7df2577eff22 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:34.479571 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3ccdc673-e25a-43ea-8ba4-7df2577eff22 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:34.480189 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3ccdc673-e25a-43ea-8ba4-7df2577eff22 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:34.657367 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-6f348faf-92d5-441b-9f2d-44e4e30269ee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:34.666117 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-6f348faf-92d5-441b-9f2d-44e4e30269ee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1514 microversion: 2.1 time: 0.704952 Feb 08 16:46:34.677105 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 362/728] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:33 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1514 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:34.814231 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3ccdc673-e25a-43ea-8ba4-7df2577eff22 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:34.842430 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3ccdc673-e25a-43ea-8ba4-7df2577eff22 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:34.843963 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3ccdc673-e25a-43ea-8ba4-7df2577eff22 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:34.845181 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-3ccdc673-e25a-43ea-8ba4-7df2577eff22 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1738 microversion: 2.20 time: 0.378752 Feb 08 16:46:34.856943 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 367/729] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:34 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1738 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:35.461877 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-f40fd017-b3b8-4c87-8677-6d318fafdd9a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:35.462617 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-f40fd017-b3b8-4c87-8677-6d318fafdd9a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:35.482808 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f40fd017-b3b8-4c87-8677-6d318fafdd9a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:35.483742 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f40fd017-b3b8-4c87-8677-6d318fafdd9a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:35.484769 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f40fd017-b3b8-4c87-8677-6d318fafdd9a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:35.485496 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f40fd017-b3b8-4c87-8677-6d318fafdd9a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:35.684461 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b9c9c14d-6ed8-4b72-a199-76605762e201 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:35.685745 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b9c9c14d-6ed8-4b72-a199-76605762e201 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:35.700262 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b9c9c14d-6ed8-4b72-a199-76605762e201 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:35.701566 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b9c9c14d-6ed8-4b72-a199-76605762e201 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:35.702570 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b9c9c14d-6ed8-4b72-a199-76605762e201 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:35.703192 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b9c9c14d-6ed8-4b72-a199-76605762e201 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:35.763041 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f40fd017-b3b8-4c87-8677-6d318fafdd9a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:35.780195 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-f40fd017-b3b8-4c87-8677-6d318fafdd9a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1710 microversion: 2.1 time: 0.322446 Feb 08 16:46:35.782879 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 363/730] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:35 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1710 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:35.864932 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-7f1ee374-62c1-4e4d-aa8a-4ae7e5599b3d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:35.865658 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7f1ee374-62c1-4e4d-aa8a-4ae7e5599b3d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:35.879651 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7f1ee374-62c1-4e4d-aa8a-4ae7e5599b3d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:35.880310 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7f1ee374-62c1-4e4d-aa8a-4ae7e5599b3d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:35.881316 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7f1ee374-62c1-4e4d-aa8a-4ae7e5599b3d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:35.884336 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7f1ee374-62c1-4e4d-aa8a-4ae7e5599b3d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:36.289579 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b9c9c14d-6ed8-4b72-a199-76605762e201 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:36.312367 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7f1ee374-62c1-4e4d-aa8a-4ae7e5599b3d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:36.325238 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b9c9c14d-6ed8-4b72-a199-76605762e201 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1514 microversion: 2.1 time: 0.643892 Feb 08 16:46:36.327125 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7f1ee374-62c1-4e4d-aa8a-4ae7e5599b3d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:36.330441 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7f1ee374-62c1-4e4d-aa8a-4ae7e5599b3d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:36.333571 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 368/731] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:35 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1514 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:36.338781 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-7f1ee374-62c1-4e4d-aa8a-4ae7e5599b3d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1738 microversion: 2.20 time: 0.475455 Feb 08 16:46:36.352031 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 364/732] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:35 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1738 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:46:36.801121 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-5ff10202-b566-47b9-b720-3d16c8808101 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:36.802480 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-5ff10202-b566-47b9-b720-3d16c8808101 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:36.810148 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5ff10202-b566-47b9-b720-3d16c8808101 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:36.825490 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5ff10202-b566-47b9-b720-3d16c8808101 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:36.829204 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5ff10202-b566-47b9-b720-3d16c8808101 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:36.829897 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5ff10202-b566-47b9-b720-3d16c8808101 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:37.217574 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-023c0aaa-70ab-4e0e-9746-5c08ed55aa31 req-c81be2d5-08ae-410d-87fd-2e4c3c3113fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34aed937-6496-4bee-8f85-9ac16933bed9", "name": "network-vif-deleted", "tag": "5bf7187c-608b-4223-8eb8-d0779f39ffb8"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:46:37.220297 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:46:37.220297 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:46:37.253938 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-023c0aaa-70ab-4e0e-9746-5c08ed55aa31 req-c81be2d5-08ae-410d-87fd-2e4c3c3113fc service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:37.254416 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-023c0aaa-70ab-4e0e-9746-5c08ed55aa31 req-c81be2d5-08ae-410d-87fd-2e4c3c3113fc service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:37.307301 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-023c0aaa-70ab-4e0e-9746-5c08ed55aa31 req-c81be2d5-08ae-410d-87fd-2e4c3c3113fc service nova] Creating event network-vif-deleted:5bf7187c-608b-4223-8eb8-d0779f39ffb8 for instance 34aed937-6496-4bee-8f85-9ac16933bed9 on hv-cinder-82786 Feb 08 16:46:37.318239 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-023c0aaa-70ab-4e0e-9746-5c08ed55aa31 req-c81be2d5-08ae-410d-87fd-2e4c3c3113fc service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105549 Feb 08 16:46:37.325924 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 365/733] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:46:37.349636 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-3fdfbb78-b80f-4719-92c3-22c1d9cba1f5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:37.350701 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-3fdfbb78-b80f-4719-92c3-22c1d9cba1f5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:37.366893 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3fdfbb78-b80f-4719-92c3-22c1d9cba1f5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:37.367339 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3fdfbb78-b80f-4719-92c3-22c1d9cba1f5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:37.368426 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3fdfbb78-b80f-4719-92c3-22c1d9cba1f5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:37.368859 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3fdfbb78-b80f-4719-92c3-22c1d9cba1f5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:37.391407 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-5ff10202-b566-47b9-b720-3d16c8808101 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:37.406920 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-5ff10202-b566-47b9-b720-3d16c8808101 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1710 microversion: 2.1 time: 0.609258 Feb 08 16:46:37.407514 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 369/734] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:36 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1710 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:37.427354 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e3013e50-8b7e-4201-8261-62095352cbe4 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:37.428009 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e3013e50-8b7e-4201-8261-62095352cbe4 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:37.467659 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e3013e50-8b7e-4201-8261-62095352cbe4 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:37.474105 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e3013e50-8b7e-4201-8261-62095352cbe4 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:37.475233 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e3013e50-8b7e-4201-8261-62095352cbe4 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:37.475890 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e3013e50-8b7e-4201-8261-62095352cbe4 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:37.535816 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-3fdfbb78-b80f-4719-92c3-22c1d9cba1f5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:37.548519 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-3fdfbb78-b80f-4719-92c3-22c1d9cba1f5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1303 microversion: 2.1 time: 0.202665 Feb 08 16:46:37.553592 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 366/735] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:37 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1303 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:37.731308 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e3013e50-8b7e-4201-8261-62095352cbe4 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:37.746692 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e3013e50-8b7e-4201-8261-62095352cbe4 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:37.750095 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e3013e50-8b7e-4201-8261-62095352cbe4 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:37.751381 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e3013e50-8b7e-4201-8261-62095352cbe4 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1738 microversion: 2.20 time: 0.342809 Feb 08 16:46:37.752706 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 370/736] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:37 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1738 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:38.247473 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-3f4ec4eb-0f02-49b3-a687-8f9630f18fc9 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Action: 'create', calling method: .version_select at 0x7fcde01e5dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2141805341"}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:46:38.272099 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-3f4ec4eb-0f02-49b3-a687-8f9630f18fc9 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Getting quotas for project 6cd968a946ad4d3d9281c64f94d2eb09. Resources: {'key_pairs'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:46:38.277155 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-3f4ec4eb-0f02-49b3-a687-8f9630f18fc9 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Getting quotas for user 2b8d57b4da614728a52f90e2d7e6ed84 and project 6cd968a946ad4d3d9281c64f94d2eb09. Resources: {'key_pairs'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:46:38.424340 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-acc0868c-097e-4efc-a675-fdf793292e89 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:38.425041 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-acc0868c-097e-4efc-a675-fdf793292e89 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:38.442338 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-acc0868c-097e-4efc-a675-fdf793292e89 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:38.442897 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-acc0868c-097e-4efc-a675-fdf793292e89 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:38.443721 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-acc0868c-097e-4efc-a675-fdf793292e89 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:38.444349 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-acc0868c-097e-4efc-a675-fdf793292e89 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:38.444985 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-3f4ec4eb-0f02-49b3-a687-8f9630f18fc9 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Getting quotas for project 6cd968a946ad4d3d9281c64f94d2eb09. Resources: {'key_pairs'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:46:38.452854 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-3f4ec4eb-0f02-49b3-a687-8f9630f18fc9 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Getting quotas for user 2b8d57b4da614728a52f90e2d7e6ed84 and project 6cd968a946ad4d3d9281c64f94d2eb09. Resources: {'key_pairs'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:46:38.477639 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-3f4ec4eb-0f02-49b3-a687-8f9630f18fc9 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.233946 Feb 08 16:46:38.483992 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 367/737] 10.222.0.35 () {60 vars in 1157 bytes} [Tue Feb 8 16:46:38 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:38.573685 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-982c8ad7-4e6f-4367-8b46-d1620eedc15f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:38.578482 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-982c8ad7-4e6f-4367-8b46-d1620eedc15f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:38.590273 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-982c8ad7-4e6f-4367-8b46-d1620eedc15f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:38.590754 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-982c8ad7-4e6f-4367-8b46-d1620eedc15f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:38.593552 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-982c8ad7-4e6f-4367-8b46-d1620eedc15f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:38.594038 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-982c8ad7-4e6f-4367-8b46-d1620eedc15f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:38.666406 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-982c8ad7-4e6f-4367-8b46-d1620eedc15f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:38.666865 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-982c8ad7-4e6f-4367-8b46-d1620eedc15f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:38.667542 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.objects.instance [None req-982c8ad7-4e6f-4367-8b46-d1620eedc15f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lazy-loading 'fault' on Instance uuid 34aed937-6496-4bee-8f85-9ac16933bed9 {{(pid=122901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:46:38.674326 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-acc0868c-097e-4efc-a675-fdf793292e89 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:38.689127 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-acc0868c-097e-4efc-a675-fdf793292e89 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1714 microversion: 2.1 time: 0.262687 Feb 08 16:46:38.689127 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 371/738] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:38 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1714 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:38.693726 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-79f90568-b908-423f-8fea-ec0cdbd10017 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2119742040", "imageRef": "6375c724-e43d-4a4f-9b1f-9675c634033b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2141805341", "networks": [{"uuid": "3382cd15-23dd-4330-8bca-8bcb7dee0e8b"}]}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:46:38.718559 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-982c8ad7-4e6f-4367-8b46-d1620eedc15f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:38.731306 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-982c8ad7-4e6f-4367-8b46-d1620eedc15f tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 200 len: 1308 microversion: 2.1 time: 0.162264 Feb 08 16:46:38.738191 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 368/739] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:38 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 1308 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:38.769423 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-46a68514-b3c6-4a68-9eeb-70d740cc9be2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:38.770455 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-46a68514-b3c6-4a68-9eeb-70d740cc9be2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:38.778632 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-46a68514-b3c6-4a68-9eeb-70d740cc9be2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:38.779271 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-46a68514-b3c6-4a68-9eeb-70d740cc9be2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:38.780272 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-46a68514-b3c6-4a68-9eeb-70d740cc9be2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:38.780984 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-46a68514-b3c6-4a68-9eeb-70d740cc9be2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:38.790084 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.network.neutron [None req-79f90568-b908-423f-8fea-ec0cdbd10017 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] validate_networks() for [('3382cd15-23dd-4330-8bca-8bcb7dee0e8b', None, None, None, None, None)] {{(pid=122902) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 16:46:39.075307 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-46a68514-b3c6-4a68-9eeb-70d740cc9be2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:39.085388 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-46a68514-b3c6-4a68-9eeb-70d740cc9be2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:39.088179 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-46a68514-b3c6-4a68-9eeb-70d740cc9be2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:39.089635 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-46a68514-b3c6-4a68-9eeb-70d740cc9be2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1738 microversion: 2.20 time: 0.324232 Feb 08 16:46:39.090317 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 369/740] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:38 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1738 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:46:39.332236 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-79f90568-b908-423f-8fea-ec0cdbd10017 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Flavor limits 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 16:46:39.332662 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-79f90568-b908-423f-8fea-ec0cdbd10017 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Image limits 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 16:46:39.333135 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-79f90568-b908-423f-8fea-ec0cdbd10017 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Flavor pref 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 16:46:39.336992 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-79f90568-b908-423f-8fea-ec0cdbd10017 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Image pref 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 16:46:39.337760 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-79f90568-b908-423f-8fea-ec0cdbd10017 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 16:46:39.347639 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-79f90568-b908-423f-8fea-ec0cdbd10017 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:39.348110 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-79f90568-b908-423f-8fea-ec0cdbd10017 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:39.348946 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-79f90568-b908-423f-8fea-ec0cdbd10017 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:39.349380 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-79f90568-b908-423f-8fea-ec0cdbd10017 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:39.370916 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-79f90568-b908-423f-8fea-ec0cdbd10017 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Getting quotas for project 6cd968a946ad4d3d9281c64f94d2eb09. Resources: {'cores', 'ram', 'instances'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:46:39.374874 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-79f90568-b908-423f-8fea-ec0cdbd10017 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Getting quotas for user 2b8d57b4da614728a52f90e2d7e6ed84 and project 6cd968a946ad4d3d9281c64f94d2eb09. Resources: {'cores', 'ram', 'instances'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:46:39.390299 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-79f90568-b908-423f-8fea-ec0cdbd10017 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Going to run 1 instances... {{(pid=122902) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 16:46:39.392753 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-79f90568-b908-423f-8fea-ec0cdbd10017 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6375c724-e43d-4a4f-9b1f-9675c634033b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 16:46:39.443873 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-79f90568-b908-423f-8fea-ec0cdbd10017 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757817 Feb 08 16:46:39.450376 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 372/741] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Feb 8 16:46:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 16:46:39.455271 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-f8213067-8868-4939-9ab3-dfcab25f5793 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:39.455920 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-f8213067-8868-4939-9ab3-dfcab25f5793 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:39.561798 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f8213067-8868-4939-9ab3-dfcab25f5793 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:39.568621 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-f8213067-8868-4939-9ab3-dfcab25f5793 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1259 microversion: 2.1 time: 0.117192 Feb 08 16:46:39.569119 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 370/742] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:39 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1259 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:39.754866 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-cde95d1b-b9d8-44db-a8b0-0aa07472f6db tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:39.755483 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-cde95d1b-b9d8-44db-a8b0-0aa07472f6db tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 34aed937-6496-4bee-8f85-9ac16933bed9] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:39.771320 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cde95d1b-b9d8-44db-a8b0-0aa07472f6db tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:39.771885 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cde95d1b-b9d8-44db-a8b0-0aa07472f6db tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:39.772678 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cde95d1b-b9d8-44db-a8b0-0aa07472f6db tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:39.773453 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cde95d1b-b9d8-44db-a8b0-0aa07472f6db tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:39.790721 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-cde95d1b-b9d8-44db-a8b0-0aa07472f6db tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] HTTP exception thrown: Instance 34aed937-6496-4bee-8f85-9ac16933bed9 could not be found. Feb 08 16:46:39.791330 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-cde95d1b-b9d8-44db-a8b0-0aa07472f6db tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Returning 404 to user: Instance 34aed937-6496-4bee-8f85-9ac16933bed9 could not be found. {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:46:39.792204 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-cde95d1b-b9d8-44db-a8b0-0aa07472f6db tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9" status: 404 len: 111 microversion: 2.1 time: 0.041483 Feb 08 16:46:39.792950 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 373/743] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:39 2022] GET /compute/v2.1/servers/34aed937-6496-4bee-8f85-9ac16933bed9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:46:40.108363 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-2f420aa5-daca-4210-a609-7123c753c0b9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:40.109277 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-2f420aa5-daca-4210-a609-7123c753c0b9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:40.116437 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2f420aa5-daca-4210-a609-7123c753c0b9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:40.118831 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2f420aa5-daca-4210-a609-7123c753c0b9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:40.120033 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2f420aa5-daca-4210-a609-7123c753c0b9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:40.120691 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2f420aa5-daca-4210-a609-7123c753c0b9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:40.276227 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-2f420aa5-daca-4210-a609-7123c753c0b9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:40.286417 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-2f420aa5-daca-4210-a609-7123c753c0b9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:40.288323 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-2f420aa5-daca-4210-a609-7123c753c0b9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:40.290168 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-2f420aa5-daca-4210-a609-7123c753c0b9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1738 microversion: 2.20 time: 0.185451 Feb 08 16:46:40.291156 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 371/744] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:40 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:40.589817 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-36618388-da71-4645-80c0-d89894c9e123 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:40.590435 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-36618388-da71-4645-80c0-d89894c9e123 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:40.600077 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-36618388-da71-4645-80c0-d89894c9e123 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:40.600526 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-36618388-da71-4645-80c0-d89894c9e123 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:40.601623 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-36618388-da71-4645-80c0-d89894c9e123 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:40.602328 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-36618388-da71-4645-80c0-d89894c9e123 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:40.672068 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-36618388-da71-4645-80c0-d89894c9e123 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:40.681255 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-36618388-da71-4645-80c0-d89894c9e123 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1263 microversion: 2.1 time: 0.098353 Feb 08 16:46:40.682022 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 374/745] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:40 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1263 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:41.308590 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ba52665b-cf11-421e-91c9-990e1fa1fab2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:41.309742 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-ba52665b-cf11-421e-91c9-990e1fa1fab2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:41.317001 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ba52665b-cf11-421e-91c9-990e1fa1fab2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:41.317134 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ba52665b-cf11-421e-91c9-990e1fa1fab2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:41.317999 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ba52665b-cf11-421e-91c9-990e1fa1fab2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:41.318512 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ba52665b-cf11-421e-91c9-990e1fa1fab2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:41.480946 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ba52665b-cf11-421e-91c9-990e1fa1fab2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:41.489836 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ba52665b-cf11-421e-91c9-990e1fa1fab2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:41.494211 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ba52665b-cf11-421e-91c9-990e1fa1fab2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:41.495727 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-ba52665b-cf11-421e-91c9-990e1fa1fab2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1738 microversion: 2.20 time: 0.191147 Feb 08 16:46:41.496343 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 372/746] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:41 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:41.698697 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-4f91462b-6129-437f-b59a-43dff53249ad tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:41.699474 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-4f91462b-6129-437f-b59a-43dff53249ad tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:41.706154 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4f91462b-6129-437f-b59a-43dff53249ad tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:41.706605 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4f91462b-6129-437f-b59a-43dff53249ad tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:41.707388 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4f91462b-6129-437f-b59a-43dff53249ad tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:41.707865 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4f91462b-6129-437f-b59a-43dff53249ad tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:41.777400 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-4f91462b-6129-437f-b59a-43dff53249ad tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:41.785597 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-4f91462b-6129-437f-b59a-43dff53249ad tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1263 microversion: 2.1 time: 0.091160 Feb 08 16:46:41.786200 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 375/747] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:41 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1263 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:42.579233 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-394d7ff9-0ed2-4985-ba5b-05cd230f2788 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:42.579862 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-394d7ff9-0ed2-4985-ba5b-05cd230f2788 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:42.591348 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-394d7ff9-0ed2-4985-ba5b-05cd230f2788 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:42.592671 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-394d7ff9-0ed2-4985-ba5b-05cd230f2788 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:42.593862 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-394d7ff9-0ed2-4985-ba5b-05cd230f2788 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:42.594312 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-394d7ff9-0ed2-4985-ba5b-05cd230f2788 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:42.741795 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-394d7ff9-0ed2-4985-ba5b-05cd230f2788 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:42.750503 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-394d7ff9-0ed2-4985-ba5b-05cd230f2788 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:42.751964 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-394d7ff9-0ed2-4985-ba5b-05cd230f2788 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:42.753373 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-394d7ff9-0ed2-4985-ba5b-05cd230f2788 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1738 microversion: 2.20 time: 0.242610 Feb 08 16:46:42.754407 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 373/748] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:42 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1738 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:42.801909 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-1d3b7004-4e30-4e5c-8eca-a2d63a41a497 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:42.802523 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-1d3b7004-4e30-4e5c-8eca-a2d63a41a497 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:42.809338 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1d3b7004-4e30-4e5c-8eca-a2d63a41a497 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:42.809794 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1d3b7004-4e30-4e5c-8eca-a2d63a41a497 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:42.810572 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1d3b7004-4e30-4e5c-8eca-a2d63a41a497 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:42.811011 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1d3b7004-4e30-4e5c-8eca-a2d63a41a497 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:42.869902 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-1d3b7004-4e30-4e5c-8eca-a2d63a41a497 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:42.877780 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-1d3b7004-4e30-4e5c-8eca-a2d63a41a497 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1311 microversion: 2.1 time: 0.079172 Feb 08 16:46:42.878415 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 376/749] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:42 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1311 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:43.774837 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d43f1ca0-daea-48e2-8155-2cc0f59107f1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:43.781412 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-d43f1ca0-daea-48e2-8155-2cc0f59107f1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:43.788694 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d43f1ca0-daea-48e2-8155-2cc0f59107f1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:43.793778 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d43f1ca0-daea-48e2-8155-2cc0f59107f1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:43.795967 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d43f1ca0-daea-48e2-8155-2cc0f59107f1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:43.798730 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d43f1ca0-daea-48e2-8155-2cc0f59107f1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:43.894915 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-f72466e2-f0b3-4b3e-96d6-5430ebfa2368 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:43.895577 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-f72466e2-f0b3-4b3e-96d6-5430ebfa2368 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:43.901984 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f72466e2-f0b3-4b3e-96d6-5430ebfa2368 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:43.902445 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f72466e2-f0b3-4b3e-96d6-5430ebfa2368 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:43.903262 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f72466e2-f0b3-4b3e-96d6-5430ebfa2368 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:43.903678 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f72466e2-f0b3-4b3e-96d6-5430ebfa2368 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:43.968831 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d43f1ca0-daea-48e2-8155-2cc0f59107f1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:43.970929 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-f72466e2-f0b3-4b3e-96d6-5430ebfa2368 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:43.980672 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d43f1ca0-daea-48e2-8155-2cc0f59107f1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:43.981900 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-f72466e2-f0b3-4b3e-96d6-5430ebfa2368 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1329 microversion: 2.1 time: 0.090388 Feb 08 16:46:43.982719 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d43f1ca0-daea-48e2-8155-2cc0f59107f1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:43.984502 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d43f1ca0-daea-48e2-8155-2cc0f59107f1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1738 microversion: 2.20 time: 0.214368 Feb 08 16:46:43.992466 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 377/750] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:43 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1329 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:43.996212 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 374/751] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:43 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:44.121065 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-a557d2d4-aac6-4aa3-970d-efdd74e9e364 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:44.121733 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-a557d2d4-aac6-4aa3-970d-efdd74e9e364 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:44.128827 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a557d2d4-aac6-4aa3-970d-efdd74e9e364 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:44.129284 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a557d2d4-aac6-4aa3-970d-efdd74e9e364 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:44.130083 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a557d2d4-aac6-4aa3-970d-efdd74e9e364 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:44.130526 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a557d2d4-aac6-4aa3-970d-efdd74e9e364 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:44.156190 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-a557d2d4-aac6-4aa3-970d-efdd74e9e364 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Going to try to terminate instance {{(pid=122902) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 16:46:44.234878 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-a557d2d4-aac6-4aa3-970d-efdd74e9e364 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "DELETE /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 204 len: 0 microversion: 2.1 time: 0.118089 Feb 08 16:46:44.235713 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 378/752] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Feb 8 16:46:44 2022] DELETE /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 16:46:44.243683 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b09a331a-3fdf-4856-aea2-1718cebdf126 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:44.244341 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-b09a331a-3fdf-4856-aea2-1718cebdf126 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:44.250649 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b09a331a-3fdf-4856-aea2-1718cebdf126 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:44.251109 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b09a331a-3fdf-4856-aea2-1718cebdf126 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:44.251973 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b09a331a-3fdf-4856-aea2-1718cebdf126 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:44.252698 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b09a331a-3fdf-4856-aea2-1718cebdf126 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:44.543380 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-b09a331a-3fdf-4856-aea2-1718cebdf126 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:44.552046 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-b09a331a-3fdf-4856-aea2-1718cebdf126 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1514 microversion: 2.1 time: 0.312187 Feb 08 16:46:44.564851 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 375/753] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:44 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1514 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:45.001825 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-a23fc0f4-d495-47ac-b369-c1bc0cd23276 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:45.002939 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-a23fc0f4-d495-47ac-b369-c1bc0cd23276 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:45.003069 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-a8188459-107c-4a5b-a31e-efb2e902e9e0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:45.003629 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-a8188459-107c-4a5b-a31e-efb2e902e9e0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:45.013215 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a23fc0f4-d495-47ac-b369-c1bc0cd23276 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:45.014058 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a8188459-107c-4a5b-a31e-efb2e902e9e0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:45.014314 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a23fc0f4-d495-47ac-b369-c1bc0cd23276 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:45.014560 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a8188459-107c-4a5b-a31e-efb2e902e9e0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:45.015429 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a8188459-107c-4a5b-a31e-efb2e902e9e0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:45.015909 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a8188459-107c-4a5b-a31e-efb2e902e9e0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:45.016900 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a23fc0f4-d495-47ac-b369-c1bc0cd23276 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:45.017746 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a23fc0f4-d495-47ac-b369-c1bc0cd23276 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:45.185376 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-a23fc0f4-d495-47ac-b369-c1bc0cd23276 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:45.193128 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-a23fc0f4-d495-47ac-b369-c1bc0cd23276 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.196341 Feb 08 16:46:45.193709 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 379/754] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:44 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:45.198869 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-a8188459-107c-4a5b-a31e-efb2e902e9e0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:45.207329 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-a8188459-107c-4a5b-a31e-efb2e902e9e0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:45.209007 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-a8188459-107c-4a5b-a31e-efb2e902e9e0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:45.210188 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-a8188459-107c-4a5b-a31e-efb2e902e9e0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1720 microversion: 2.20 time: 0.211194 Feb 08 16:46:45.211386 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 376/755] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:44 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1720 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:46:45.571476 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-1fdae30b-5335-488b-9c48-b535e4bc24df tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:45.572182 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-1fdae30b-5335-488b-9c48-b535e4bc24df tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:45.579379 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1fdae30b-5335-488b-9c48-b535e4bc24df tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:45.579961 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1fdae30b-5335-488b-9c48-b535e4bc24df tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:45.580837 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1fdae30b-5335-488b-9c48-b535e4bc24df tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:45.581277 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1fdae30b-5335-488b-9c48-b535e4bc24df tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:45.723329 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-1fdae30b-5335-488b-9c48-b535e4bc24df tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:45.731449 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-1fdae30b-5335-488b-9c48-b535e4bc24df tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1514 microversion: 2.1 time: 0.163746 Feb 08 16:46:45.732048 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 380/756] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:45 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:46.210437 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-237722d7-b0e2-44fc-8d26-9c7d942ef0a4 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:46.212279 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-237722d7-b0e2-44fc-8d26-9c7d942ef0a4 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:46.218803 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-237722d7-b0e2-44fc-8d26-9c7d942ef0a4 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:46.219246 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-237722d7-b0e2-44fc-8d26-9c7d942ef0a4 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:46.220068 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-237722d7-b0e2-44fc-8d26-9c7d942ef0a4 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:46.220501 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-237722d7-b0e2-44fc-8d26-9c7d942ef0a4 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:46.229032 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-51502568-3b2e-4652-a3e6-405b4735e6de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:46.230203 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-51502568-3b2e-4652-a3e6-405b4735e6de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:46.237136 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-51502568-3b2e-4652-a3e6-405b4735e6de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:46.237875 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-51502568-3b2e-4652-a3e6-405b4735e6de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:46.238890 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-51502568-3b2e-4652-a3e6-405b4735e6de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:46.239528 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-51502568-3b2e-4652-a3e6-405b4735e6de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:46.401229 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-237722d7-b0e2-44fc-8d26-9c7d942ef0a4 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:46.412421 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-237722d7-b0e2-44fc-8d26-9c7d942ef0a4 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.205094 Feb 08 16:46:46.413800 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 377/757] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:46 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:46.449471 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-51502568-3b2e-4652-a3e6-405b4735e6de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:46.460019 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-51502568-3b2e-4652-a3e6-405b4735e6de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:46.462125 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-51502568-3b2e-4652-a3e6-405b4735e6de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:46.463520 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-51502568-3b2e-4652-a3e6-405b4735e6de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1720 microversion: 2.20 time: 0.238359 Feb 08 16:46:46.464300 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 381/758] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:46 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1720 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:46:46.748772 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-8e7fb558-4a5a-485e-adb3-6fe1ab49f801 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:46.749300 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-8e7fb558-4a5a-485e-adb3-6fe1ab49f801 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:46.755484 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8e7fb558-4a5a-485e-adb3-6fe1ab49f801 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:46.755971 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8e7fb558-4a5a-485e-adb3-6fe1ab49f801 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:46.756756 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8e7fb558-4a5a-485e-adb3-6fe1ab49f801 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:46.757196 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8e7fb558-4a5a-485e-adb3-6fe1ab49f801 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:46.903067 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-8e7fb558-4a5a-485e-adb3-6fe1ab49f801 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:46.910405 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-8e7fb558-4a5a-485e-adb3-6fe1ab49f801 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1514 microversion: 2.1 time: 0.165417 Feb 08 16:46:46.910968 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 378/759] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:46 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:47.431798 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-ff13beba-5dd2-4127-9d7a-daefae570eb4 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:47.433559 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-ff13beba-5dd2-4127-9d7a-daefae570eb4 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:47.441323 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ff13beba-5dd2-4127-9d7a-daefae570eb4 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:47.441770 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ff13beba-5dd2-4127-9d7a-daefae570eb4 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:47.442612 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ff13beba-5dd2-4127-9d7a-daefae570eb4 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:47.443049 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ff13beba-5dd2-4127-9d7a-daefae570eb4 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:47.481737 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-f8ec0260-d5df-438f-a9ae-50f337a6ee8f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:47.482342 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-f8ec0260-d5df-438f-a9ae-50f337a6ee8f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:47.505928 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f8ec0260-d5df-438f-a9ae-50f337a6ee8f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:47.506680 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f8ec0260-d5df-438f-a9ae-50f337a6ee8f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:47.507476 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f8ec0260-d5df-438f-a9ae-50f337a6ee8f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:47.508602 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f8ec0260-d5df-438f-a9ae-50f337a6ee8f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:47.679179 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f8ec0260-d5df-438f-a9ae-50f337a6ee8f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:47.687508 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ff13beba-5dd2-4127-9d7a-daefae570eb4 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:47.697495 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-ff13beba-5dd2-4127-9d7a-daefae570eb4 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.270315 Feb 08 16:46:47.698642 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f8ec0260-d5df-438f-a9ae-50f337a6ee8f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:47.698845 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 382/760] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:47 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:47.700650 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f8ec0260-d5df-438f-a9ae-50f337a6ee8f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:47.702490 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-f8ec0260-d5df-438f-a9ae-50f337a6ee8f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1720 microversion: 2.20 time: 0.224495 Feb 08 16:46:47.711888 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 379/761] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:47 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1720 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:46:47.928548 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-daedc2aa-3fad-4032-b92a-8a9cbdf17b2b tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:47.929302 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-daedc2aa-3fad-4032-b92a-8a9cbdf17b2b tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:47.938086 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-daedc2aa-3fad-4032-b92a-8a9cbdf17b2b tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:47.938605 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-daedc2aa-3fad-4032-b92a-8a9cbdf17b2b tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:47.939620 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-daedc2aa-3fad-4032-b92a-8a9cbdf17b2b tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:47.940276 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-daedc2aa-3fad-4032-b92a-8a9cbdf17b2b tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:48.098150 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-642035a0-0477-4f69-aa35-5efdb3e84583 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:48.101523 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-642035a0-0477-4f69-aa35-5efdb3e84583 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: c3bef185-a618-44ad-a691-59b9ec1303e8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:48.114423 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-642035a0-0477-4f69-aa35-5efdb3e84583 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:48.122227 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-642035a0-0477-4f69-aa35-5efdb3e84583 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:48.123091 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-642035a0-0477-4f69-aa35-5efdb3e84583 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:48.123530 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-642035a0-0477-4f69-aa35-5efdb3e84583 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:48.152372 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-daedc2aa-3fad-4032-b92a-8a9cbdf17b2b tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:48.160290 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-daedc2aa-3fad-4032-b92a-8a9cbdf17b2b tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1514 microversion: 2.1 time: 0.236287 Feb 08 16:46:48.163443 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 383/762] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:47 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1514 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:48.218338 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-5b6f7dec-16f8-413b-8e9b-6952af75de31 req-2ef5a4b0-cb15-4f2a-975e-d3fc847064b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da00c476-8246-413e-889c-d22fe63e2ef8", "name": "network-vif-unplugged", "status": "completed", "tag": "dc601835-5363-4bdf-9b05-9e711057cbd2"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:46:48.220010 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:46:48.220010 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:46:48.248436 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-5b6f7dec-16f8-413b-8e9b-6952af75de31 req-2ef5a4b0-cb15-4f2a-975e-d3fc847064b3 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:48.248896 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-5b6f7dec-16f8-413b-8e9b-6952af75de31 req-2ef5a4b0-cb15-4f2a-975e-d3fc847064b3 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:48.262554 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.objects.instance [None req-642035a0-0477-4f69-aa35-5efdb3e84583 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lazy-loading 'services' on Instance uuid c3bef185-a618-44ad-a691-59b9ec1303e8 {{(pid=122901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:46:48.290075 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-5b6f7dec-16f8-413b-8e9b-6952af75de31 req-2ef5a4b0-cb15-4f2a-975e-d3fc847064b3 service nova] Creating event network-vif-unplugged:dc601835-5363-4bdf-9b05-9e711057cbd2 for instance da00c476-8246-413e-889c-d22fe63e2ef8 on hv-cinder-82786 Feb 08 16:46:48.310815 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-5b6f7dec-16f8-413b-8e9b-6952af75de31 req-2ef5a4b0-cb15-4f2a-975e-d3fc847064b3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096156 Feb 08 16:46:48.311676 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 384/763] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:46:48.345818 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-642035a0-0477-4f69-aa35-5efdb3e84583 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8/os-volume_attachments/48e675f0-8ca7-4d15-803b-70a6d058c6a3" status: 202 len: 0 microversion: 2.1 time: 0.258095 Feb 08 16:46:48.361542 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 380/764] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Feb 8 16:46:48 2022] DELETE /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8/os-volume_attachments/48e675f0-8ca7-4d15-803b-70a6d058c6a3 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:46:48.724908 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e3c3ce07-880d-46ea-b361-caad1ac67f24 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:48.725845 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e3c3ce07-880d-46ea-b361-caad1ac67f24 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:48.729728 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-bf3b466f-ad81-4042-9358-cb06976e43ae tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:48.730899 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-bf3b466f-ad81-4042-9358-cb06976e43ae tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:48.738121 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e3c3ce07-880d-46ea-b361-caad1ac67f24 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:48.738855 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e3c3ce07-880d-46ea-b361-caad1ac67f24 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:48.739366 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bf3b466f-ad81-4042-9358-cb06976e43ae tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:48.739850 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bf3b466f-ad81-4042-9358-cb06976e43ae tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:48.740631 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e3c3ce07-880d-46ea-b361-caad1ac67f24 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:48.740762 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bf3b466f-ad81-4042-9358-cb06976e43ae tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:48.741408 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e3c3ce07-880d-46ea-b361-caad1ac67f24 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:48.745201 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bf3b466f-ad81-4042-9358-cb06976e43ae tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:48.953678 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e3c3ce07-880d-46ea-b361-caad1ac67f24 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:48.966981 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e3c3ce07-880d-46ea-b361-caad1ac67f24 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:48.968813 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e3c3ce07-880d-46ea-b361-caad1ac67f24 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:48.970201 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e3c3ce07-880d-46ea-b361-caad1ac67f24 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1720 microversion: 2.20 time: 0.252194 Feb 08 16:46:48.971444 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 381/765] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:48 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1720 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:49.013827 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-bf3b466f-ad81-4042-9358-cb06976e43ae tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:49.024607 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-bf3b466f-ad81-4042-9358-cb06976e43ae tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.313678 Feb 08 16:46:49.025376 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 385/766] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:48 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:49.181360 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-88ee4240-0474-4eca-96c3-c17eebe0605c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:49.182226 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-88ee4240-0474-4eca-96c3-c17eebe0605c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:49.188728 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-88ee4240-0474-4eca-96c3-c17eebe0605c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:49.189600 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-88ee4240-0474-4eca-96c3-c17eebe0605c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:49.190614 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-88ee4240-0474-4eca-96c3-c17eebe0605c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:49.191252 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-88ee4240-0474-4eca-96c3-c17eebe0605c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:49.390141 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-88ee4240-0474-4eca-96c3-c17eebe0605c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:49.399510 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-88ee4240-0474-4eca-96c3-c17eebe0605c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1514 microversion: 2.1 time: 0.223505 Feb 08 16:46:49.408861 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 382/767] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:49 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:49.996993 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-46dafde0-6366-40f6-8673-18598041b444 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:49.997599 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-46dafde0-6366-40f6-8673-18598041b444 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:50.004246 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-46dafde0-6366-40f6-8673-18598041b444 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:50.005007 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-46dafde0-6366-40f6-8673-18598041b444 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:50.005864 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-46dafde0-6366-40f6-8673-18598041b444 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:50.006368 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-46dafde0-6366-40f6-8673-18598041b444 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:50.040549 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-58c15c2b-bc53-4d29-87c8-d04f42e4f19b tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:50.041200 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-58c15c2b-bc53-4d29-87c8-d04f42e4f19b tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:50.047049 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-58c15c2b-bc53-4d29-87c8-d04f42e4f19b tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:50.047496 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-58c15c2b-bc53-4d29-87c8-d04f42e4f19b tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:50.048303 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-58c15c2b-bc53-4d29-87c8-d04f42e4f19b tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:50.048739 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-58c15c2b-bc53-4d29-87c8-d04f42e4f19b tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:50.165803 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-46dafde0-6366-40f6-8673-18598041b444 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:50.174388 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-46dafde0-6366-40f6-8673-18598041b444 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:50.175903 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-46dafde0-6366-40f6-8673-18598041b444 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:50.177448 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-46dafde0-6366-40f6-8673-18598041b444 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1720 microversion: 2.20 time: 0.184068 Feb 08 16:46:50.178487 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 386/768] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:49 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:50.198603 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-58c15c2b-bc53-4d29-87c8-d04f42e4f19b tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:50.206132 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-58c15c2b-bc53-4d29-87c8-d04f42e4f19b tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.169270 Feb 08 16:46:50.206719 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 383/769] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:50 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:50.429310 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-5bd47712-667e-4335-b0d4-bd9460e7b6d5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:50.430164 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-5bd47712-667e-4335-b0d4-bd9460e7b6d5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:50.436471 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5bd47712-667e-4335-b0d4-bd9460e7b6d5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:50.436922 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5bd47712-667e-4335-b0d4-bd9460e7b6d5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:50.437742 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5bd47712-667e-4335-b0d4-bd9460e7b6d5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:50.438182 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5bd47712-667e-4335-b0d4-bd9460e7b6d5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:50.585681 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-5bd47712-667e-4335-b0d4-bd9460e7b6d5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:50.593218 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-5bd47712-667e-4335-b0d4-bd9460e7b6d5 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1514 microversion: 2.1 time: 0.171611 Feb 08 16:46:50.593778 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 387/770] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:50 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:51.196162 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d68e3cb3-10dd-4c87-9023-fc0a2884dcf5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:51.196781 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-d68e3cb3-10dd-4c87-9023-fc0a2884dcf5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:51.203294 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d68e3cb3-10dd-4c87-9023-fc0a2884dcf5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:51.203742 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d68e3cb3-10dd-4c87-9023-fc0a2884dcf5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:51.204549 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d68e3cb3-10dd-4c87-9023-fc0a2884dcf5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:51.204985 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d68e3cb3-10dd-4c87-9023-fc0a2884dcf5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:51.223328 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c6654c70-3eff-49e1-a885-71043653d3e5 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:51.224016 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c6654c70-3eff-49e1-a885-71043653d3e5 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:51.231042 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c6654c70-3eff-49e1-a885-71043653d3e5 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:51.231497 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c6654c70-3eff-49e1-a885-71043653d3e5 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:51.232433 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c6654c70-3eff-49e1-a885-71043653d3e5 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:51.232878 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c6654c70-3eff-49e1-a885-71043653d3e5 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:51.363992 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d68e3cb3-10dd-4c87-9023-fc0a2884dcf5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:51.374730 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d68e3cb3-10dd-4c87-9023-fc0a2884dcf5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:51.376249 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d68e3cb3-10dd-4c87-9023-fc0a2884dcf5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:51.377747 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d68e3cb3-10dd-4c87-9023-fc0a2884dcf5 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1720 microversion: 2.20 time: 0.185107 Feb 08 16:46:51.378314 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 384/771] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:51 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1720 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:51.401379 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c6654c70-3eff-49e1-a885-71043653d3e5 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:51.409019 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c6654c70-3eff-49e1-a885-71043653d3e5 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.189318 Feb 08 16:46:51.409876 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 388/772] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:51 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:51.610585 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-085ef7a8-1459-4934-a143-d70c569e6cdd tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:51.612207 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-085ef7a8-1459-4934-a143-d70c569e6cdd tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:51.622820 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-085ef7a8-1459-4934-a143-d70c569e6cdd tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:51.623432 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-085ef7a8-1459-4934-a143-d70c569e6cdd tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:51.624377 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-085ef7a8-1459-4934-a143-d70c569e6cdd tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:51.624941 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-085ef7a8-1459-4934-a143-d70c569e6cdd tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:51.765858 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-085ef7a8-1459-4934-a143-d70c569e6cdd tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:51.773647 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-085ef7a8-1459-4934-a143-d70c569e6cdd tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1514 microversion: 2.1 time: 0.166700 Feb 08 16:46:51.774352 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 385/773] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:51 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:52.396706 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e73924b1-d287-4525-8647-94f51956e9e3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:52.397382 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e73924b1-d287-4525-8647-94f51956e9e3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:52.404600 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e73924b1-d287-4525-8647-94f51956e9e3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:52.405139 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e73924b1-d287-4525-8647-94f51956e9e3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:52.406028 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e73924b1-d287-4525-8647-94f51956e9e3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:52.406798 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e73924b1-d287-4525-8647-94f51956e9e3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:52.427126 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-fe9545fe-3f59-4e35-b83e-477e1d504461 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:52.428364 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-fe9545fe-3f59-4e35-b83e-477e1d504461 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:52.442128 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fe9545fe-3f59-4e35-b83e-477e1d504461 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:52.442692 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fe9545fe-3f59-4e35-b83e-477e1d504461 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:52.444039 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fe9545fe-3f59-4e35-b83e-477e1d504461 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:52.447933 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fe9545fe-3f59-4e35-b83e-477e1d504461 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:52.622093 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e73924b1-d287-4525-8647-94f51956e9e3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:52.642567 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e73924b1-d287-4525-8647-94f51956e9e3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:52.644711 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e73924b1-d287-4525-8647-94f51956e9e3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:52.646385 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e73924b1-d287-4525-8647-94f51956e9e3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1720 microversion: 2.20 time: 0.253170 Feb 08 16:46:52.647162 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 389/774] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:52 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1720 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:52.695129 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-fe9545fe-3f59-4e35-b83e-477e1d504461 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:52.706424 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-fe9545fe-3f59-4e35-b83e-477e1d504461 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.284319 Feb 08 16:46:52.715036 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 386/775] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:52 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:52.791986 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-7085de67-b249-46bd-842a-3d908e161518 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:52.792640 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-7085de67-b249-46bd-842a-3d908e161518 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:52.798674 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7085de67-b249-46bd-842a-3d908e161518 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:52.799123 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7085de67-b249-46bd-842a-3d908e161518 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:52.799943 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7085de67-b249-46bd-842a-3d908e161518 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:52.800381 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7085de67-b249-46bd-842a-3d908e161518 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:52.939541 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-7085de67-b249-46bd-842a-3d908e161518 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:52.946918 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-7085de67-b249-46bd-842a-3d908e161518 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1514 microversion: 2.1 time: 0.160328 Feb 08 16:46:52.947493 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 390/776] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:52 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:53.666586 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-43ee4967-1d6e-4fa9-8676-4fd5eda706b7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:53.667160 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-43ee4967-1d6e-4fa9-8676-4fd5eda706b7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:53.674379 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-43ee4967-1d6e-4fa9-8676-4fd5eda706b7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:53.674868 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-43ee4967-1d6e-4fa9-8676-4fd5eda706b7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:53.675723 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-43ee4967-1d6e-4fa9-8676-4fd5eda706b7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:53.676252 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-43ee4967-1d6e-4fa9-8676-4fd5eda706b7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:53.725294 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-5d51d22d-9a11-4e7b-8759-bf05118b242e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:53.725981 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-5d51d22d-9a11-4e7b-8759-bf05118b242e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:53.740201 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5d51d22d-9a11-4e7b-8759-bf05118b242e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:53.741303 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5d51d22d-9a11-4e7b-8759-bf05118b242e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:53.742495 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5d51d22d-9a11-4e7b-8759-bf05118b242e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:53.743138 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5d51d22d-9a11-4e7b-8759-bf05118b242e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:53.856494 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-43ee4967-1d6e-4fa9-8676-4fd5eda706b7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:53.874434 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-43ee4967-1d6e-4fa9-8676-4fd5eda706b7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:53.875959 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-43ee4967-1d6e-4fa9-8676-4fd5eda706b7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:53.877388 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-43ee4967-1d6e-4fa9-8676-4fd5eda706b7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1720 microversion: 2.20 time: 0.214418 Feb 08 16:46:53.878135 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 387/777] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:53 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1720 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:53.915048 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-5d51d22d-9a11-4e7b-8759-bf05118b242e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:53.923342 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-5d51d22d-9a11-4e7b-8759-bf05118b242e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.202375 Feb 08 16:46:53.936559 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 391/778] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:53 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:53.962344 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-bf10b9a8-d625-4be9-80cc-93020427f55c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:53.962950 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-bf10b9a8-d625-4be9-80cc-93020427f55c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:53.969363 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bf10b9a8-d625-4be9-80cc-93020427f55c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:53.969819 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bf10b9a8-d625-4be9-80cc-93020427f55c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:53.970613 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bf10b9a8-d625-4be9-80cc-93020427f55c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:53.971053 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bf10b9a8-d625-4be9-80cc-93020427f55c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:54.112529 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-bf10b9a8-d625-4be9-80cc-93020427f55c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:54.122586 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-bf10b9a8-d625-4be9-80cc-93020427f55c tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1514 microversion: 2.1 time: 0.163837 Feb 08 16:46:54.126394 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 388/779] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:53 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:54.896319 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e52aca02-7b07-4917-b691-dc23bca88992 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:54.896949 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e52aca02-7b07-4917-b691-dc23bca88992 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:54.903846 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e52aca02-7b07-4917-b691-dc23bca88992 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:54.904312 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e52aca02-7b07-4917-b691-dc23bca88992 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:54.905164 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e52aca02-7b07-4917-b691-dc23bca88992 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:54.905610 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e52aca02-7b07-4917-b691-dc23bca88992 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:54.953951 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-c9b9a92c-ef17-49b8-86a6-92d45f1de28f tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:54.954569 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-c9b9a92c-ef17-49b8-86a6-92d45f1de28f tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:54.961718 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c9b9a92c-ef17-49b8-86a6-92d45f1de28f tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:54.962410 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c9b9a92c-ef17-49b8-86a6-92d45f1de28f tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:54.966731 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c9b9a92c-ef17-49b8-86a6-92d45f1de28f tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:54.967333 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c9b9a92c-ef17-49b8-86a6-92d45f1de28f tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:55.052935 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e52aca02-7b07-4917-b691-dc23bca88992 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:55.069049 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e52aca02-7b07-4917-b691-dc23bca88992 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:55.071878 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e52aca02-7b07-4917-b691-dc23bca88992 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:55.073302 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e52aca02-7b07-4917-b691-dc23bca88992 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1720 microversion: 2.20 time: 0.180894 Feb 08 16:46:55.073994 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 392/780] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:54 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:55.140008 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-ea066c44-3cba-4b03-8536-a5bd366cacfc tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:55.140619 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-ea066c44-3cba-4b03-8536-a5bd366cacfc tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:55.147224 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ea066c44-3cba-4b03-8536-a5bd366cacfc tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:55.147672 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ea066c44-3cba-4b03-8536-a5bd366cacfc tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:55.157722 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ea066c44-3cba-4b03-8536-a5bd366cacfc tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:55.158171 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ea066c44-3cba-4b03-8536-a5bd366cacfc tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:55.343662 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ea066c44-3cba-4b03-8536-a5bd366cacfc tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:55.352087 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-ea066c44-3cba-4b03-8536-a5bd366cacfc tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1514 microversion: 2.1 time: 0.215114 Feb 08 16:46:55.352670 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 393/781] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:55 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1514 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:55.378870 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c9b9a92c-ef17-49b8-86a6-92d45f1de28f tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:55.385766 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-c9b9a92c-ef17-49b8-86a6-92d45f1de28f tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.435353 Feb 08 16:46:55.386445 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 389/782] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:54 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:56.090338 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-82540dd6-87cd-4e8d-92d5-d7cdb7b24fe2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:56.090986 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-82540dd6-87cd-4e8d-92d5-d7cdb7b24fe2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:56.097566 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-82540dd6-87cd-4e8d-92d5-d7cdb7b24fe2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:56.098020 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-82540dd6-87cd-4e8d-92d5-d7cdb7b24fe2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:56.098808 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-82540dd6-87cd-4e8d-92d5-d7cdb7b24fe2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:56.099250 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-82540dd6-87cd-4e8d-92d5-d7cdb7b24fe2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:56.255440 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-82540dd6-87cd-4e8d-92d5-d7cdb7b24fe2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:56.265049 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-82540dd6-87cd-4e8d-92d5-d7cdb7b24fe2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:56.266748 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-82540dd6-87cd-4e8d-92d5-d7cdb7b24fe2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:56.267988 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-82540dd6-87cd-4e8d-92d5-d7cdb7b24fe2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1720 microversion: 2.20 time: 0.181350 Feb 08 16:46:56.268559 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 394/783] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:56 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:56.368498 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-3e3c9dc8-9625-41bb-ad5c-5bf04445ea3a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:56.369111 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-3e3c9dc8-9625-41bb-ad5c-5bf04445ea3a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:56.375463 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3e3c9dc8-9625-41bb-ad5c-5bf04445ea3a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:56.376072 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3e3c9dc8-9625-41bb-ad5c-5bf04445ea3a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:56.376866 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3e3c9dc8-9625-41bb-ad5c-5bf04445ea3a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:56.377562 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3e3c9dc8-9625-41bb-ad5c-5bf04445ea3a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:56.403225 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-5a4798f7-a4e5-4186-a69d-ddf613aea134 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:56.403905 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-5a4798f7-a4e5-4186-a69d-ddf613aea134 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:56.409744 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5a4798f7-a4e5-4186-a69d-ddf613aea134 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:56.410195 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5a4798f7-a4e5-4186-a69d-ddf613aea134 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:56.410979 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5a4798f7-a4e5-4186-a69d-ddf613aea134 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:56.411417 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5a4798f7-a4e5-4186-a69d-ddf613aea134 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:56.516634 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-3e3c9dc8-9625-41bb-ad5c-5bf04445ea3a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:56.524562 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-3e3c9dc8-9625-41bb-ad5c-5bf04445ea3a tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1514 microversion: 2.1 time: 0.159741 Feb 08 16:46:56.525347 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 390/784] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:56 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:56.552709 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-5a4798f7-a4e5-4186-a69d-ddf613aea134 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:56.560149 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-5a4798f7-a4e5-4186-a69d-ddf613aea134 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.160478 Feb 08 16:46:56.560712 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 395/785] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:56 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:57.288702 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-73f0498a-12e3-4c37-88be-a712002e1647 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:57.289248 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-73f0498a-12e3-4c37-88be-a712002e1647 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:57.295148 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-73f0498a-12e3-4c37-88be-a712002e1647 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:57.295602 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-73f0498a-12e3-4c37-88be-a712002e1647 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:57.296423 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-73f0498a-12e3-4c37-88be-a712002e1647 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:57.296862 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-73f0498a-12e3-4c37-88be-a712002e1647 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:57.429088 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-73f0498a-12e3-4c37-88be-a712002e1647 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:57.437273 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-73f0498a-12e3-4c37-88be-a712002e1647 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:57.438745 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-73f0498a-12e3-4c37-88be-a712002e1647 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:57.439948 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-73f0498a-12e3-4c37-88be-a712002e1647 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1720 microversion: 2.20 time: 0.155603 Feb 08 16:46:57.440508 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 391/786] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:57 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:46:57.540996 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-7d94ee39-0068-4cb7-99db-04fdd262c8ee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:57.541567 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-7d94ee39-0068-4cb7-99db-04fdd262c8ee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:57.547863 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7d94ee39-0068-4cb7-99db-04fdd262c8ee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:57.548317 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7d94ee39-0068-4cb7-99db-04fdd262c8ee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:57.549094 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7d94ee39-0068-4cb7-99db-04fdd262c8ee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:57.549532 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7d94ee39-0068-4cb7-99db-04fdd262c8ee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:57.576584 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-c91ff84b-06a8-43ad-96e7-051ec4e24cf7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:57.577199 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-c91ff84b-06a8-43ad-96e7-051ec4e24cf7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:57.583035 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c91ff84b-06a8-43ad-96e7-051ec4e24cf7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:57.583493 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c91ff84b-06a8-43ad-96e7-051ec4e24cf7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:57.584303 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c91ff84b-06a8-43ad-96e7-051ec4e24cf7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:57.584742 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c91ff84b-06a8-43ad-96e7-051ec4e24cf7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:57.686939 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-7d94ee39-0068-4cb7-99db-04fdd262c8ee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:57.694212 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-7d94ee39-0068-4cb7-99db-04fdd262c8ee tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1514 microversion: 2.1 time: 0.157088 Feb 08 16:46:57.694790 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 396/787] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:57 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:57.717187 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c91ff84b-06a8-43ad-96e7-051ec4e24cf7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:57.724588 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-c91ff84b-06a8-43ad-96e7-051ec4e24cf7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.151571 Feb 08 16:46:57.725164 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 392/788] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:57 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:58.457421 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-44d27f77-a16a-41a9-9b90-c9ed2429bbc2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:58.458034 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-44d27f77-a16a-41a9-9b90-c9ed2429bbc2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:58.464711 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-44d27f77-a16a-41a9-9b90-c9ed2429bbc2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:58.465171 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-44d27f77-a16a-41a9-9b90-c9ed2429bbc2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:58.465983 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-44d27f77-a16a-41a9-9b90-c9ed2429bbc2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:58.466427 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-44d27f77-a16a-41a9-9b90-c9ed2429bbc2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:58.597318 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-44d27f77-a16a-41a9-9b90-c9ed2429bbc2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:58.605520 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-44d27f77-a16a-41a9-9b90-c9ed2429bbc2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:58.606998 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-44d27f77-a16a-41a9-9b90-c9ed2429bbc2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:58.608172 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-44d27f77-a16a-41a9-9b90-c9ed2429bbc2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1720 microversion: 2.20 time: 0.154387 Feb 08 16:46:58.608713 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 397/789] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:58 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:58.712062 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-c05c714a-0498-4a33-bbbe-2e2ccf98deed tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:58.712682 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-c05c714a-0498-4a33-bbbe-2e2ccf98deed tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:58.718933 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c05c714a-0498-4a33-bbbe-2e2ccf98deed tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:58.719388 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c05c714a-0498-4a33-bbbe-2e2ccf98deed tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:58.720210 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c05c714a-0498-4a33-bbbe-2e2ccf98deed tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:58.720649 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c05c714a-0498-4a33-bbbe-2e2ccf98deed tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:58.741086 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-f302f3ec-b86b-41d6-8558-69a01e083ff7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:58.741699 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-f302f3ec-b86b-41d6-8558-69a01e083ff7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:58.747774 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f302f3ec-b86b-41d6-8558-69a01e083ff7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:58.748268 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f302f3ec-b86b-41d6-8558-69a01e083ff7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:58.749057 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f302f3ec-b86b-41d6-8558-69a01e083ff7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:58.749498 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f302f3ec-b86b-41d6-8558-69a01e083ff7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:58.853796 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c05c714a-0498-4a33-bbbe-2e2ccf98deed tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:58.861240 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-c05c714a-0498-4a33-bbbe-2e2ccf98deed tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1514 microversion: 2.1 time: 0.153593 Feb 08 16:46:58.861904 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 393/790] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:58 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:46:58.884046 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-f302f3ec-b86b-41d6-8558-69a01e083ff7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:58.891216 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-f302f3ec-b86b-41d6-8558-69a01e083ff7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.153713 Feb 08 16:46:58.891808 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 398/791] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:58 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:46:59.626001 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-8eaa2824-1a51-43e5-a9b7-d5a6a0d1c444 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:59.626615 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-8eaa2824-1a51-43e5-a9b7-d5a6a0d1c444 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:59.633073 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8eaa2824-1a51-43e5-a9b7-d5a6a0d1c444 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:59.633539 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8eaa2824-1a51-43e5-a9b7-d5a6a0d1c444 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:59.634326 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8eaa2824-1a51-43e5-a9b7-d5a6a0d1c444 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:59.634766 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8eaa2824-1a51-43e5-a9b7-d5a6a0d1c444 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:59.833088 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-8eaa2824-1a51-43e5-a9b7-d5a6a0d1c444 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:59.841648 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-8eaa2824-1a51-43e5-a9b7-d5a6a0d1c444 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:59.843362 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-8eaa2824-1a51-43e5-a9b7-d5a6a0d1c444 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:46:59.844795 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-8eaa2824-1a51-43e5-a9b7-d5a6a0d1c444 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1720 microversion: 2.20 time: 0.222488 Feb 08 16:46:59.845357 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 394/792] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:46:59 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1720 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:46:59.877577 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-86c7589b-5892-4e73-98c4-44246a689788 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:59.878332 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-86c7589b-5892-4e73-98c4-44246a689788 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:59.885558 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-86c7589b-5892-4e73-98c4-44246a689788 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:59.886283 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-86c7589b-5892-4e73-98c4-44246a689788 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:59.887178 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-86c7589b-5892-4e73-98c4-44246a689788 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:59.887742 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-86c7589b-5892-4e73-98c4-44246a689788 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:59.909697 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b2263663-4a9c-4e1f-b7f3-b847bc9f2753 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:46:59.911130 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-b2263663-4a9c-4e1f-b7f3-b847bc9f2753 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:46:59.918712 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b2263663-4a9c-4e1f-b7f3-b847bc9f2753 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:59.920205 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b2263663-4a9c-4e1f-b7f3-b847bc9f2753 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:46:59.921625 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b2263663-4a9c-4e1f-b7f3-b847bc9f2753 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:46:59.922271 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b2263663-4a9c-4e1f-b7f3-b847bc9f2753 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:00.153276 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-86c7589b-5892-4e73-98c4-44246a689788 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:00.160926 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-86c7589b-5892-4e73-98c4-44246a689788 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1514 microversion: 2.1 time: 0.287552 Feb 08 16:47:00.161595 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 399/793] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:59 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1514 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:00.181584 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-b2263663-4a9c-4e1f-b7f3-b847bc9f2753 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:00.189392 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-b2263663-4a9c-4e1f-b7f3-b847bc9f2753 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.284137 Feb 08 16:47:00.190246 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 395/794] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:46:59 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:00.509028 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-6bd633ec-24e4-43e6-baa6-7521dca6d662 req-cb516b81-0b1b-42ef-931b-c3a6b3f9a442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b3f77f-d45a-4763-8843-929d858a24a3", "tag": "ef3eb329-986b-442c-9350-fab47f0d2892"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:47:00.510751 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:47:00.510751 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:47:00.518103 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-6bd633ec-24e4-43e6-baa6-7521dca6d662 req-cb516b81-0b1b-42ef-931b-c3a6b3f9a442 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:00.518739 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-6bd633ec-24e4-43e6-baa6-7521dca6d662 req-cb516b81-0b1b-42ef-931b-c3a6b3f9a442 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:00.534803 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-6bd633ec-24e4-43e6-baa6-7521dca6d662 req-cb516b81-0b1b-42ef-931b-c3a6b3f9a442 service nova] Creating event network-changed:ef3eb329-986b-442c-9350-fab47f0d2892 for instance 20b3f77f-d45a-4763-8843-929d858a24a3 on hv-cinder-82786 Feb 08 16:47:00.540834 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-6bd633ec-24e4-43e6-baa6-7521dca6d662 req-cb516b81-0b1b-42ef-931b-c3a6b3f9a442 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036186 Feb 08 16:47:00.542048 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 400/795] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:47:00.862527 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-0cc5da29-5f22-4eee-a5cb-f3263ce42b65 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:00.863380 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-0cc5da29-5f22-4eee-a5cb-f3263ce42b65 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:00.870234 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0cc5da29-5f22-4eee-a5cb-f3263ce42b65 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:00.871016 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0cc5da29-5f22-4eee-a5cb-f3263ce42b65 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:00.871914 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0cc5da29-5f22-4eee-a5cb-f3263ce42b65 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:00.872535 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0cc5da29-5f22-4eee-a5cb-f3263ce42b65 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:01.100789 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0cc5da29-5f22-4eee-a5cb-f3263ce42b65 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:01.111331 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0cc5da29-5f22-4eee-a5cb-f3263ce42b65 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:01.112948 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0cc5da29-5f22-4eee-a5cb-f3263ce42b65 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:01.114345 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-0cc5da29-5f22-4eee-a5cb-f3263ce42b65 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1720 microversion: 2.20 time: 0.255504 Feb 08 16:47:01.115112 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 396/796] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:00 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1720 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:47:01.159888 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-1c092564-919d-464d-b7e7-e97f1d8b4cab tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:01.160480 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-1c092564-919d-464d-b7e7-e97f1d8b4cab tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: c3bef185-a618-44ad-a691-59b9ec1303e8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:01.167368 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1c092564-919d-464d-b7e7-e97f1d8b4cab tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:01.167862 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1c092564-919d-464d-b7e7-e97f1d8b4cab tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:01.168653 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1c092564-919d-464d-b7e7-e97f1d8b4cab tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:01.169107 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1c092564-919d-464d-b7e7-e97f1d8b4cab tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:01.178163 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-20c0a0d5-d56f-424a-b24c-f7b233f4d6bb tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:01.178852 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-20c0a0d5-d56f-424a-b24c-f7b233f4d6bb tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:01.185938 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-20c0a0d5-d56f-424a-b24c-f7b233f4d6bb tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:01.186472 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-20c0a0d5-d56f-424a-b24c-f7b233f4d6bb tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:01.187363 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-20c0a0d5-d56f-424a-b24c-f7b233f4d6bb tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:01.187899 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-20c0a0d5-d56f-424a-b24c-f7b233f4d6bb tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:01.195164 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-1c092564-919d-464d-b7e7-e97f1d8b4cab tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: c3bef185-a618-44ad-a691-59b9ec1303e8] Going to try to terminate instance {{(pid=122902) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 16:47:01.282688 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-1c092564-919d-464d-b7e7-e97f1d8b4cab tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "DELETE /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8" status: 204 len: 0 microversion: 2.1 time: 0.120639 Feb 08 16:47:01.282688 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 401/797] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Feb 8 16:47:01 2022] DELETE /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 16:47:01.285923 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-ceb9185c-85ad-41ee-b408-88ef66d7e1b7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:01.286618 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-ceb9185c-85ad-41ee-b408-88ef66d7e1b7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:01.293643 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ceb9185c-85ad-41ee-b408-88ef66d7e1b7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:01.294099 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ceb9185c-85ad-41ee-b408-88ef66d7e1b7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:01.294903 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ceb9185c-85ad-41ee-b408-88ef66d7e1b7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:01.295345 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ceb9185c-85ad-41ee-b408-88ef66d7e1b7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:01.428583 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-20c0a0d5-d56f-424a-b24c-f7b233f4d6bb tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:01.437842 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ceb9185c-85ad-41ee-b408-88ef66d7e1b7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:01.440412 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-20c0a0d5-d56f-424a-b24c-f7b233f4d6bb tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1514 microversion: 2.1 time: 0.265874 Feb 08 16:47:01.441434 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 397/798] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:01 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1514 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:01.449602 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-198f9ee3-cb3f-4436-a53a-6b5c8d676e16 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:01.451864 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-198f9ee3-cb3f-4436-a53a-6b5c8d676e16 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: c3bef185-a618-44ad-a691-59b9ec1303e8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:01.453762 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-ceb9185c-85ad-41ee-b408-88ef66d7e1b7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.173933 Feb 08 16:47:01.454351 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 402/799] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:01 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:01.459216 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-198f9ee3-cb3f-4436-a53a-6b5c8d676e16 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:01.459704 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-198f9ee3-cb3f-4436-a53a-6b5c8d676e16 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:01.461454 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-198f9ee3-cb3f-4436-a53a-6b5c8d676e16 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:01.462032 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-198f9ee3-cb3f-4436-a53a-6b5c8d676e16 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:01.598145 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-198f9ee3-cb3f-4436-a53a-6b5c8d676e16 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:01.605941 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-198f9ee3-cb3f-4436-a53a-6b5c8d676e16 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8" status: 200 len: 1515 microversion: 2.1 time: 0.163405 Feb 08 16:47:01.606510 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 398/800] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:01 2022] GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:02.133924 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-ec9e7758-e261-44e5-8e31-d84b3db9f926 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:02.134425 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-ec9e7758-e261-44e5-8e31-d84b3db9f926 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:02.140298 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ec9e7758-e261-44e5-8e31-d84b3db9f926 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:02.140754 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ec9e7758-e261-44e5-8e31-d84b3db9f926 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:02.141542 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ec9e7758-e261-44e5-8e31-d84b3db9f926 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:02.141988 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ec9e7758-e261-44e5-8e31-d84b3db9f926 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:02.300185 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ec9e7758-e261-44e5-8e31-d84b3db9f926 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:02.308705 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ec9e7758-e261-44e5-8e31-d84b3db9f926 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:02.310538 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ec9e7758-e261-44e5-8e31-d84b3db9f926 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:02.312024 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-ec9e7758-e261-44e5-8e31-d84b3db9f926 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1720 microversion: 2.20 time: 0.182377 Feb 08 16:47:02.324549 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 403/801] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:02 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1720 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:02.458112 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-47ebf094-305f-4748-bd20-ebb030949286 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:02.458689 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-47ebf094-305f-4748-bd20-ebb030949286 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:02.465237 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-47ebf094-305f-4748-bd20-ebb030949286 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:02.465768 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-47ebf094-305f-4748-bd20-ebb030949286 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:02.466562 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-47ebf094-305f-4748-bd20-ebb030949286 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:02.467007 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-47ebf094-305f-4748-bd20-ebb030949286 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:02.472155 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-705be6db-18f0-4790-bb88-cc8e391bf4b7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:02.472859 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-705be6db-18f0-4790-bb88-cc8e391bf4b7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:02.479130 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-705be6db-18f0-4790-bb88-cc8e391bf4b7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:02.479586 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-705be6db-18f0-4790-bb88-cc8e391bf4b7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:02.480415 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-705be6db-18f0-4790-bb88-cc8e391bf4b7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:02.480837 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-705be6db-18f0-4790-bb88-cc8e391bf4b7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:02.498037 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-47ebf094-305f-4748-bd20-ebb030949286 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:02.498578 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-47ebf094-305f-4748-bd20-ebb030949286 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:02.499025 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.objects.instance [None req-47ebf094-305f-4748-bd20-ebb030949286 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lazy-loading 'fault' on Instance uuid 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed {{(pid=122901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:47:02.541704 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-47ebf094-305f-4748-bd20-ebb030949286 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5eff85a200a4a599e0cefe8d681d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b57fcb90a594af1b70daaecbf9efd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:02.549157 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-47ebf094-305f-4748-bd20-ebb030949286 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 200 len: 1308 microversion: 2.1 time: 0.094672 Feb 08 16:47:02.559076 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 399/802] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:02 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:02.559076 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-b8a11626-8d6e-42e6-b5e2-ac85000071cb req-09f11f2f-cd3e-4c35-9431-59d565f3c850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "547dd9a2-9f3b-49f5-a2f7-34e5283b9aed", "name": "network-vif-deleted", "tag": "6d242b95-699b-413d-9b89-1b82e91da648"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:47:02.559076 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:47:02.559076 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:47:02.564455 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-b8a11626-8d6e-42e6-b5e2-ac85000071cb req-09f11f2f-cd3e-4c35-9431-59d565f3c850 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:02.564887 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-b8a11626-8d6e-42e6-b5e2-ac85000071cb req-09f11f2f-cd3e-4c35-9431-59d565f3c850 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:02.579281 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-b8a11626-8d6e-42e6-b5e2-ac85000071cb req-09f11f2f-cd3e-4c35-9431-59d565f3c850 service nova] Creating event network-vif-deleted:6d242b95-699b-413d-9b89-1b82e91da648 for instance 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed on hv-cinder-82786 Feb 08 16:47:02.584335 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-b8a11626-8d6e-42e6-b5e2-ac85000071cb req-09f11f2f-cd3e-4c35-9431-59d565f3c850 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032222 Feb 08 16:47:02.584945 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 400/803] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:47:02.615482 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-705be6db-18f0-4790-bb88-cc8e391bf4b7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:02.623814 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-705be6db-18f0-4790-bb88-cc8e391bf4b7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.157241 Feb 08 16:47:02.623979 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-6d7bb509-7389-4d89-b8b6-f795870a391d tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:02.624425 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 404/804] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:02 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:47:02.624629 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-6d7bb509-7389-4d89-b8b6-f795870a391d tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: c3bef185-a618-44ad-a691-59b9ec1303e8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:02.630914 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6d7bb509-7389-4d89-b8b6-f795870a391d tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:02.631372 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6d7bb509-7389-4d89-b8b6-f795870a391d tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:02.632184 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6d7bb509-7389-4d89-b8b6-f795870a391d tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:02.632704 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6d7bb509-7389-4d89-b8b6-f795870a391d tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:02.793947 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-6d7bb509-7389-4d89-b8b6-f795870a391d tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:02.801829 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-6d7bb509-7389-4d89-b8b6-f795870a391d tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8" status: 200 len: 1515 microversion: 2.1 time: 0.181815 Feb 08 16:47:02.802772 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 401/805] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:02 2022] GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:47:03.332382 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-9d4cb5af-493f-4521-80dc-0e85c8d947fb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:03.332993 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-9d4cb5af-493f-4521-80dc-0e85c8d947fb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:03.339188 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9d4cb5af-493f-4521-80dc-0e85c8d947fb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:03.339641 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9d4cb5af-493f-4521-80dc-0e85c8d947fb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:03.340451 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9d4cb5af-493f-4521-80dc-0e85c8d947fb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:03.340891 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9d4cb5af-493f-4521-80dc-0e85c8d947fb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:03.478127 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9d4cb5af-493f-4521-80dc-0e85c8d947fb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:03.486323 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9d4cb5af-493f-4521-80dc-0e85c8d947fb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:03.487852 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9d4cb5af-493f-4521-80dc-0e85c8d947fb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:03.489000 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-9d4cb5af-493f-4521-80dc-0e85c8d947fb tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1663 microversion: 2.20 time: 0.160370 Feb 08 16:47:03.489557 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 405/806] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:03 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:03.506971 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b0f8e306-c363-4673-ba87-a165d8a1cd7b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56e1f198-eaa4-4162-bc65-1afdb8be0c15"}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:47:03.508121 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-b0f8e306-c363-4673-ba87-a165d8a1cd7b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:03.514307 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b0f8e306-c363-4673-ba87-a165d8a1cd7b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:03.514766 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b0f8e306-c363-4673-ba87-a165d8a1cd7b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:03.515550 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b0f8e306-c363-4673-ba87-a165d8a1cd7b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:03.516090 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b0f8e306-c363-4673-ba87-a165d8a1cd7b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:03.565915 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-eb7f1e0a-c8d3-427e-8059-e201a1b35c99 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:03.566531 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-eb7f1e0a-c8d3-427e-8059-e201a1b35c99 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] [instance: 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:03.572383 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eb7f1e0a-c8d3-427e-8059-e201a1b35c99 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:03.572830 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eb7f1e0a-c8d3-427e-8059-e201a1b35c99 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:03.573606 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eb7f1e0a-c8d3-427e-8059-e201a1b35c99 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:03.574043 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eb7f1e0a-c8d3-427e-8059-e201a1b35c99 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:03.587152 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-eb7f1e0a-c8d3-427e-8059-e201a1b35c99 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] HTTP exception thrown: Instance 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed could not be found. Feb 08 16:47:03.587746 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-eb7f1e0a-c8d3-427e-8059-e201a1b35c99 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] Returning 404 to user: Instance 547dd9a2-9f3b-49f5-a2f7-34e5283b9aed could not be found. {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:47:03.588598 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-eb7f1e0a-c8d3-427e-8059-e201a1b35c99 tempest-AttachVolumeNegativeTest-1279397391 tempest-AttachVolumeNegativeTest-1279397391-project] 10.222.0.35 "GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed" status: 404 len: 111 microversion: 2.1 time: 0.026287 Feb 08 16:47:03.589136 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 406/807] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:03 2022] GET /compute/v2.1/servers/547dd9a2-9f3b-49f5-a2f7-34e5283b9aed => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 08 16:47:03.641740 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-7f7131b1-988f-4947-925f-524275f83c6c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:03.642573 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-7f7131b1-988f-4947-925f-524275f83c6c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:03.649561 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7f7131b1-988f-4947-925f-524275f83c6c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:03.650305 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7f7131b1-988f-4947-925f-524275f83c6c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:03.651361 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7f7131b1-988f-4947-925f-524275f83c6c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:03.651908 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7f7131b1-988f-4947-925f-524275f83c6c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:03.803995 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-7f7131b1-988f-4947-925f-524275f83c6c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:03.811526 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-b0f8e306-c363-4673-ba87-a165d8a1cd7b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "POST /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.308124 Feb 08 16:47:03.812317 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-7f7131b1-988f-4947-925f-524275f83c6c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.175059 Feb 08 16:47:03.814355 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 407/808] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:03 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:47:03.819070 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 402/809] 10.222.0.35 () {62 vars in 1363 bytes} [Tue Feb 8 16:47:03 2022] POST /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments => generated 188 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:47:03.826611 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-be724165-1d4e-4921-9006-9c0b20186a12 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:03.827234 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-be724165-1d4e-4921-9006-9c0b20186a12 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: c3bef185-a618-44ad-a691-59b9ec1303e8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:03.834801 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-be724165-1d4e-4921-9006-9c0b20186a12 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:03.835267 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-be724165-1d4e-4921-9006-9c0b20186a12 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:03.836636 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-be724165-1d4e-4921-9006-9c0b20186a12 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:03.837080 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-be724165-1d4e-4921-9006-9c0b20186a12 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:03.945828 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e3ad243c-6cb8-4b15-90b9-90c6089293e2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:47:03.946817 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e3ad243c-6cb8-4b15-90b9-90c6089293e2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:03.955875 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e3ad243c-6cb8-4b15-90b9-90c6089293e2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:03.956545 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e3ad243c-6cb8-4b15-90b9-90c6089293e2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:03.957504 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e3ad243c-6cb8-4b15-90b9-90c6089293e2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:03.958105 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e3ad243c-6cb8-4b15-90b9-90c6089293e2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:04.017193 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-be724165-1d4e-4921-9006-9c0b20186a12 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:04.025549 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-be724165-1d4e-4921-9006-9c0b20186a12 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8" status: 200 len: 1515 microversion: 2.1 time: 0.202556 Feb 08 16:47:04.026124 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 408/810] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:03 2022] GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8 => generated 1515 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:04.249468 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e3ad243c-6cb8-4b15-90b9-90c6089293e2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "POST /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/action" status: 202 len: 0 microversion: 2.20 time: 0.308538 Feb 08 16:47:04.254233 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 403/811] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Feb 8 16:47:03 2022] POST /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 08 16:47:04.259967 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-dae542b6-e59c-4d77-a572-e682d2a523ba tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:04.261619 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-dae542b6-e59c-4d77-a572-e682d2a523ba tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:04.269267 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dae542b6-e59c-4d77-a572-e682d2a523ba tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:04.269723 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dae542b6-e59c-4d77-a572-e682d2a523ba tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:04.270524 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dae542b6-e59c-4d77-a572-e682d2a523ba tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:04.271026 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dae542b6-e59c-4d77-a572-e682d2a523ba tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:04.485977 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-dae542b6-e59c-4d77-a572-e682d2a523ba tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:04.500663 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-dae542b6-e59c-4d77-a572-e682d2a523ba tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:04.503840 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-dae542b6-e59c-4d77-a572-e682d2a523ba tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:04.505559 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-dae542b6-e59c-4d77-a572-e682d2a523ba tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1749 microversion: 2.20 time: 0.249894 Feb 08 16:47:04.506410 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 409/812] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:04 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1749 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:47:04.703802 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-1f8ade73-5faa-436f-b270-00c851ed7211 req-3fe26c00-2151-47cb-b82c-39fd00304eba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3bef185-a618-44ad-a691-59b9ec1303e8", "name": "network-vif-deleted", "tag": "caf61fd0-7dff-4794-942a-dd5f8ce46e23"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:47:04.706436 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:47:04.706436 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:47:04.716399 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-1f8ade73-5faa-436f-b270-00c851ed7211 req-3fe26c00-2151-47cb-b82c-39fd00304eba service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:04.716844 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-1f8ade73-5faa-436f-b270-00c851ed7211 req-3fe26c00-2151-47cb-b82c-39fd00304eba service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:04.736356 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-1f8ade73-5faa-436f-b270-00c851ed7211 req-3fe26c00-2151-47cb-b82c-39fd00304eba service nova] Creating event network-vif-deleted:caf61fd0-7dff-4794-942a-dd5f8ce46e23 for instance c3bef185-a618-44ad-a691-59b9ec1303e8 on hv-cinder-82786 Feb 08 16:47:04.742197 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-1f8ade73-5faa-436f-b270-00c851ed7211 req-3fe26c00-2151-47cb-b82c-39fd00304eba service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146585 Feb 08 16:47:04.743590 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 404/813] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:47:04.829123 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-5c2b2c36-b9bb-4ffd-8810-524e293e8129 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:04.830028 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-5c2b2c36-b9bb-4ffd-8810-524e293e8129 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:04.839411 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5c2b2c36-b9bb-4ffd-8810-524e293e8129 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:04.840240 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5c2b2c36-b9bb-4ffd-8810-524e293e8129 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:04.841111 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5c2b2c36-b9bb-4ffd-8810-524e293e8129 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:04.841906 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5c2b2c36-b9bb-4ffd-8810-524e293e8129 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:05.043329 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-c4f49203-0010-488d-ae6c-88846893cdc2 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:05.044223 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-c4f49203-0010-488d-ae6c-88846893cdc2 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: c3bef185-a618-44ad-a691-59b9ec1303e8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:05.054768 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-5c2b2c36-b9bb-4ffd-8810-524e293e8129 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:05.055215 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c4f49203-0010-488d-ae6c-88846893cdc2 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:05.055943 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c4f49203-0010-488d-ae6c-88846893cdc2 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:05.056992 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c4f49203-0010-488d-ae6c-88846893cdc2 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:05.057674 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c4f49203-0010-488d-ae6c-88846893cdc2 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:05.063239 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-5c2b2c36-b9bb-4ffd-8810-524e293e8129 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.237615 Feb 08 16:47:05.073137 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 410/814] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:04 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:05.104610 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c4f49203-0010-488d-ae6c-88846893cdc2 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:05.105160 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c4f49203-0010-488d-ae6c-88846893cdc2 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:05.105854 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.objects.instance [None req-c4f49203-0010-488d-ae6c-88846893cdc2 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lazy-loading 'fault' on Instance uuid c3bef185-a618-44ad-a691-59b9ec1303e8 {{(pid=122901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:47:05.170471 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c4f49203-0010-488d-ae6c-88846893cdc2 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7421e6184e497eb23bf9f87957322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55220445da0d49ac8713e9036e8e6e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:05.177417 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-c4f49203-0010-488d-ae6c-88846893cdc2 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8" status: 200 len: 1309 microversion: 2.1 time: 0.138763 Feb 08 16:47:05.178255 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 405/815] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:05 2022] GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8 => generated 1309 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:05.523519 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e2de167e-df91-435b-81a3-f5eecdf3f03d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:05.524163 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e2de167e-df91-435b-81a3-f5eecdf3f03d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:05.530610 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e2de167e-df91-435b-81a3-f5eecdf3f03d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:05.530996 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e2de167e-df91-435b-81a3-f5eecdf3f03d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:05.531997 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e2de167e-df91-435b-81a3-f5eecdf3f03d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:05.533175 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e2de167e-df91-435b-81a3-f5eecdf3f03d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:05.678288 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e2de167e-df91-435b-81a3-f5eecdf3f03d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:05.687591 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e2de167e-df91-435b-81a3-f5eecdf3f03d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:05.689113 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e2de167e-df91-435b-81a3-f5eecdf3f03d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:05.690268 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e2de167e-df91-435b-81a3-f5eecdf3f03d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1751 microversion: 2.20 time: 0.170475 Feb 08 16:47:05.690822 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 411/816] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:05 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:06.080987 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-07a62a1a-5a22-4acb-a5bf-e9f5ee37970c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:06.081857 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-07a62a1a-5a22-4acb-a5bf-e9f5ee37970c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:06.091496 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-07a62a1a-5a22-4acb-a5bf-e9f5ee37970c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:06.092392 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-07a62a1a-5a22-4acb-a5bf-e9f5ee37970c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:06.093201 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-07a62a1a-5a22-4acb-a5bf-e9f5ee37970c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:06.093900 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-07a62a1a-5a22-4acb-a5bf-e9f5ee37970c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:06.194437 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-8356986f-1382-4ade-a421-79cdbab568e3 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:06.196194 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-8356986f-1382-4ade-a421-79cdbab568e3 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] [instance: c3bef185-a618-44ad-a691-59b9ec1303e8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:06.202315 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8356986f-1382-4ade-a421-79cdbab568e3 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:06.203435 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8356986f-1382-4ade-a421-79cdbab568e3 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:06.204436 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8356986f-1382-4ade-a421-79cdbab568e3 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:06.205034 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8356986f-1382-4ade-a421-79cdbab568e3 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:06.219629 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-8356986f-1382-4ade-a421-79cdbab568e3 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] HTTP exception thrown: Instance c3bef185-a618-44ad-a691-59b9ec1303e8 could not be found. Feb 08 16:47:06.220479 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-8356986f-1382-4ade-a421-79cdbab568e3 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] Returning 404 to user: Instance c3bef185-a618-44ad-a691-59b9ec1303e8 could not be found. {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:47:06.221491 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-8356986f-1382-4ade-a421-79cdbab568e3 tempest-VolumesSnapshotTestJSON-1947240681 tempest-VolumesSnapshotTestJSON-1947240681-project] 10.222.0.35 "GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8" status: 404 len: 111 microversion: 2.1 time: 0.031003 Feb 08 16:47:06.222531 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 412/817] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:06 2022] GET /compute/v2.1/servers/c3bef185-a618-44ad-a691-59b9ec1303e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 08 16:47:06.244366 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-07a62a1a-5a22-4acb-a5bf-e9f5ee37970c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:06.253152 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-07a62a1a-5a22-4acb-a5bf-e9f5ee37970c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.176394 Feb 08 16:47:06.253867 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 406/818] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:06 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:06.319001 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-c7ffe6c7-39b2-4fae-a1c6-0e2936d49c41 req-2896ce53-8dfc-4cd8-b18c-29576b4df38e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b3f77f-d45a-4763-8843-929d858a24a3", "name": "network-vif-plugged", "status": "completed", "tag": "ef3eb329-986b-442c-9350-fab47f0d2892"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:47:06.321292 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:47:06.321292 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:47:06.329877 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-c7ffe6c7-39b2-4fae-a1c6-0e2936d49c41 req-2896ce53-8dfc-4cd8-b18c-29576b4df38e service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:06.330332 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-c7ffe6c7-39b2-4fae-a1c6-0e2936d49c41 req-2896ce53-8dfc-4cd8-b18c-29576b4df38e service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:06.341764 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-c7ffe6c7-39b2-4fae-a1c6-0e2936d49c41 req-2896ce53-8dfc-4cd8-b18c-29576b4df38e service nova] Creating event network-vif-plugged:ef3eb329-986b-442c-9350-fab47f0d2892 for instance 20b3f77f-d45a-4763-8843-929d858a24a3 on hv-cinder-82786 Feb 08 16:47:06.346365 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-c7ffe6c7-39b2-4fae-a1c6-0e2936d49c41 req-2896ce53-8dfc-4cd8-b18c-29576b4df38e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031114 Feb 08 16:47:06.346956 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 413/819] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:47:06.709241 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-7328deef-f689-410e-b5ad-bf60d97eb43e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:06.709777 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7328deef-f689-410e-b5ad-bf60d97eb43e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:06.716530 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7328deef-f689-410e-b5ad-bf60d97eb43e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:06.716978 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7328deef-f689-410e-b5ad-bf60d97eb43e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:06.717756 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7328deef-f689-410e-b5ad-bf60d97eb43e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:06.718188 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7328deef-f689-410e-b5ad-bf60d97eb43e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:06.852488 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7328deef-f689-410e-b5ad-bf60d97eb43e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:06.861031 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7328deef-f689-410e-b5ad-bf60d97eb43e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:06.862627 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7328deef-f689-410e-b5ad-bf60d97eb43e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:06.863804 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-7328deef-f689-410e-b5ad-bf60d97eb43e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.158372 Feb 08 16:47:06.864363 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 407/820] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:06 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:07.124810 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c1a6047a-a97e-4245-bc95-73b244b518df tempest-VolumesTestJSON-1242580365 tempest-VolumesTestJSON-1242580365-project] Calling method '.version_select at 0x7fcde0da9ee0>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:07.173418 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c1a6047a-a97e-4245-bc95-73b244b518df tempest-VolumesTestJSON-1242580365 tempest-VolumesTestJSON-1242580365-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/a8f033fc-79e2-4d58-a146-e1632e720c11" status: 200 len: 351 microversion: 2.1 time: 0.053209 Feb 08 16:47:07.174073 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 414/821] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Feb 8 16:47:07 2022] GET /compute/v2.1/os-volumes/a8f033fc-79e2-4d58-a146-e1632e720c11 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:47:07.270070 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-7d55c1fd-3524-4d54-a905-78f6937deeed tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:07.270762 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7d55c1fd-3524-4d54-a905-78f6937deeed tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:07.277908 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7d55c1fd-3524-4d54-a905-78f6937deeed tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:07.278463 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7d55c1fd-3524-4d54-a905-78f6937deeed tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:07.279323 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7d55c1fd-3524-4d54-a905-78f6937deeed tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:07.279890 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7d55c1fd-3524-4d54-a905-78f6937deeed tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:07.470364 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7d55c1fd-3524-4d54-a905-78f6937deeed tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:07.478411 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-7d55c1fd-3524-4d54-a905-78f6937deeed tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.211881 Feb 08 16:47:07.479048 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 408/822] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:07 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:07.882679 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-8f76cdcc-044a-4442-856d-b05fdfba0941 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:07.883829 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-8f76cdcc-044a-4442-856d-b05fdfba0941 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:07.890901 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8f76cdcc-044a-4442-856d-b05fdfba0941 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:07.891368 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8f76cdcc-044a-4442-856d-b05fdfba0941 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:07.892201 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8f76cdcc-044a-4442-856d-b05fdfba0941 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:07.892895 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8f76cdcc-044a-4442-856d-b05fdfba0941 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:08.095147 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-8f76cdcc-044a-4442-856d-b05fdfba0941 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:08.105378 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-8f76cdcc-044a-4442-856d-b05fdfba0941 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:08.107165 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-8f76cdcc-044a-4442-856d-b05fdfba0941 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:08.108390 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-8f76cdcc-044a-4442-856d-b05fdfba0941 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.229979 Feb 08 16:47:08.115650 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 415/823] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:07 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:08.499602 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-9b4c3b45-e31e-4e69-bdfc-2adb2a9d0f96 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:08.500612 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-9b4c3b45-e31e-4e69-bdfc-2adb2a9d0f96 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:08.518759 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9b4c3b45-e31e-4e69-bdfc-2adb2a9d0f96 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:08.519219 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9b4c3b45-e31e-4e69-bdfc-2adb2a9d0f96 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:08.520056 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9b4c3b45-e31e-4e69-bdfc-2adb2a9d0f96 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:08.520493 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9b4c3b45-e31e-4e69-bdfc-2adb2a9d0f96 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:08.537281 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-f06db094-7bfa-4c4d-b5a3-13f65b773186 tempest-VolumesTestJSON-1242580365 tempest-VolumesTestJSON-1242580365-project] Calling method '.version_select at 0x7fcde00ed1f0>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:08.590413 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-f06db094-7bfa-4c4d-b5a3-13f65b773186 tempest-VolumesTestJSON-1242580365 tempest-VolumesTestJSON-1242580365-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/0bf724c0-9498-45c0-b3d0-15c9b6da2c46" status: 200 len: 351 microversion: 2.1 time: 0.056612 Feb 08 16:47:08.591014 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 416/824] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Feb 8 16:47:08 2022] GET /compute/v2.1/os-volumes/0bf724c0-9498-45c0-b3d0-15c9b6da2c46 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:47:08.679940 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-9b4c3b45-e31e-4e69-bdfc-2adb2a9d0f96 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:08.687166 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-9b4c3b45-e31e-4e69-bdfc-2adb2a9d0f96 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.191499 Feb 08 16:47:08.687739 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 409/825] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:08 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:09.127300 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-ff12ccb6-02ed-4732-aff9-05b41c25f101 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:09.127971 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-ff12ccb6-02ed-4732-aff9-05b41c25f101 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:09.134796 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ff12ccb6-02ed-4732-aff9-05b41c25f101 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:09.135258 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ff12ccb6-02ed-4732-aff9-05b41c25f101 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:09.136099 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ff12ccb6-02ed-4732-aff9-05b41c25f101 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:09.136545 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ff12ccb6-02ed-4732-aff9-05b41c25f101 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:09.271467 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ff12ccb6-02ed-4732-aff9-05b41c25f101 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:09.279688 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ff12ccb6-02ed-4732-aff9-05b41c25f101 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:09.281205 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ff12ccb6-02ed-4732-aff9-05b41c25f101 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:09.282360 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-ff12ccb6-02ed-4732-aff9-05b41c25f101 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.159028 Feb 08 16:47:09.282943 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 417/826] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:09 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:09.704416 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-0f882fb1-2eb8-44db-9f2c-e65dad80f371 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:09.705058 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-0f882fb1-2eb8-44db-9f2c-e65dad80f371 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:09.712856 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0f882fb1-2eb8-44db-9f2c-e65dad80f371 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:09.713305 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0f882fb1-2eb8-44db-9f2c-e65dad80f371 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:09.714092 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0f882fb1-2eb8-44db-9f2c-e65dad80f371 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:09.714694 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0f882fb1-2eb8-44db-9f2c-e65dad80f371 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:09.881502 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0f882fb1-2eb8-44db-9f2c-e65dad80f371 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:09.891175 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-0f882fb1-2eb8-44db-9f2c-e65dad80f371 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.190259 Feb 08 16:47:09.891790 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 410/827] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:09 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:10.300529 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-79b6ce9a-0e48-4cfe-9a79-275dc081e8b3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:10.301166 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-79b6ce9a-0e48-4cfe-9a79-275dc081e8b3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:10.308279 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-79b6ce9a-0e48-4cfe-9a79-275dc081e8b3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:10.308739 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-79b6ce9a-0e48-4cfe-9a79-275dc081e8b3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:10.309533 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-79b6ce9a-0e48-4cfe-9a79-275dc081e8b3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:10.309978 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-79b6ce9a-0e48-4cfe-9a79-275dc081e8b3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:10.443533 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-79b6ce9a-0e48-4cfe-9a79-275dc081e8b3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:10.451965 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-79b6ce9a-0e48-4cfe-9a79-275dc081e8b3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:10.453470 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-79b6ce9a-0e48-4cfe-9a79-275dc081e8b3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:10.454658 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-79b6ce9a-0e48-4cfe-9a79-275dc081e8b3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.158007 Feb 08 16:47:10.455237 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 418/828] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:10 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:10.908090 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-96aae094-041b-4acc-a049-966ef5138737 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:10.908703 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-96aae094-041b-4acc-a049-966ef5138737 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:10.914917 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-96aae094-041b-4acc-a049-966ef5138737 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:10.915362 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-96aae094-041b-4acc-a049-966ef5138737 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:10.916170 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-96aae094-041b-4acc-a049-966ef5138737 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:10.916623 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-96aae094-041b-4acc-a049-966ef5138737 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:11.071473 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-96aae094-041b-4acc-a049-966ef5138737 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:11.079032 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-96aae094-041b-4acc-a049-966ef5138737 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.174708 Feb 08 16:47:11.079586 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 411/829] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:10 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:11.472491 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-fc04e560-8436-439f-920a-96ba623946f8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:11.473074 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-fc04e560-8436-439f-920a-96ba623946f8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:11.479640 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fc04e560-8436-439f-920a-96ba623946f8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:11.480197 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fc04e560-8436-439f-920a-96ba623946f8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:11.481048 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fc04e560-8436-439f-920a-96ba623946f8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:11.481507 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fc04e560-8436-439f-920a-96ba623946f8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:11.624660 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-fc04e560-8436-439f-920a-96ba623946f8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:11.633793 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-fc04e560-8436-439f-920a-96ba623946f8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:11.635323 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-fc04e560-8436-439f-920a-96ba623946f8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:11.642078 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-fc04e560-8436-439f-920a-96ba623946f8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.173249 Feb 08 16:47:11.642700 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 419/830] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:11 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:12.095576 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ed166a9b-0a69-41af-b1db-bbc6726c5a92 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:12.096143 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-ed166a9b-0a69-41af-b1db-bbc6726c5a92 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:12.102981 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ed166a9b-0a69-41af-b1db-bbc6726c5a92 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:12.103424 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ed166a9b-0a69-41af-b1db-bbc6726c5a92 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:12.104216 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ed166a9b-0a69-41af-b1db-bbc6726c5a92 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:12.104645 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ed166a9b-0a69-41af-b1db-bbc6726c5a92 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:12.236278 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ed166a9b-0a69-41af-b1db-bbc6726c5a92 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:12.243415 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-ed166a9b-0a69-41af-b1db-bbc6726c5a92 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.151504 Feb 08 16:47:12.244015 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 412/831] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:12 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:12.659513 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-9c3feb34-c7f1-4cc5-b418-91f807ad5cac tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:12.660289 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-9c3feb34-c7f1-4cc5-b418-91f807ad5cac tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:12.667447 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9c3feb34-c7f1-4cc5-b418-91f807ad5cac tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:12.667999 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9c3feb34-c7f1-4cc5-b418-91f807ad5cac tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:12.668793 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9c3feb34-c7f1-4cc5-b418-91f807ad5cac tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:12.669234 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9c3feb34-c7f1-4cc5-b418-91f807ad5cac tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:12.810838 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9c3feb34-c7f1-4cc5-b418-91f807ad5cac tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:12.821810 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9c3feb34-c7f1-4cc5-b418-91f807ad5cac tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:12.823316 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9c3feb34-c7f1-4cc5-b418-91f807ad5cac tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:12.824526 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-9c3feb34-c7f1-4cc5-b418-91f807ad5cac tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.168733 Feb 08 16:47:12.833375 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 420/832] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:12 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:13.260813 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-5e3120f4-2924-4d1c-96bc-12ff62181eb1 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:13.261554 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-5e3120f4-2924-4d1c-96bc-12ff62181eb1 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:13.270222 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5e3120f4-2924-4d1c-96bc-12ff62181eb1 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:13.270805 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5e3120f4-2924-4d1c-96bc-12ff62181eb1 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:13.271682 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5e3120f4-2924-4d1c-96bc-12ff62181eb1 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:13.272231 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5e3120f4-2924-4d1c-96bc-12ff62181eb1 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:13.417847 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-5e3120f4-2924-4d1c-96bc-12ff62181eb1 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:13.425247 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-5e3120f4-2924-4d1c-96bc-12ff62181eb1 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.168701 Feb 08 16:47:13.426129 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 413/833] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:13 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:13.843936 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-a11bd569-fbff-4b71-9473-65ad78b69f9c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:13.844571 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-a11bd569-fbff-4b71-9473-65ad78b69f9c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:13.850753 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a11bd569-fbff-4b71-9473-65ad78b69f9c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:13.851202 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a11bd569-fbff-4b71-9473-65ad78b69f9c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:13.852254 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a11bd569-fbff-4b71-9473-65ad78b69f9c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:13.852688 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a11bd569-fbff-4b71-9473-65ad78b69f9c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:13.985127 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-a11bd569-fbff-4b71-9473-65ad78b69f9c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:13.993746 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-a11bd569-fbff-4b71-9473-65ad78b69f9c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:13.995182 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-a11bd569-fbff-4b71-9473-65ad78b69f9c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:13.996368 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-a11bd569-fbff-4b71-9473-65ad78b69f9c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.156129 Feb 08 16:47:13.996927 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 421/834] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:13 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:14.443178 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-82eb469e-1b40-434b-b5a4-4c462102be72 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:14.443782 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-82eb469e-1b40-434b-b5a4-4c462102be72 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:14.450852 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-82eb469e-1b40-434b-b5a4-4c462102be72 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:14.451304 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-82eb469e-1b40-434b-b5a4-4c462102be72 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:14.452117 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-82eb469e-1b40-434b-b5a4-4c462102be72 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:14.452565 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-82eb469e-1b40-434b-b5a4-4c462102be72 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:14.586384 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-82eb469e-1b40-434b-b5a4-4c462102be72 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:14.593689 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-82eb469e-1b40-434b-b5a4-4c462102be72 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.154214 Feb 08 16:47:14.594265 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 414/835] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:14 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:15.014369 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-fbb0de3a-de1e-40ec-93c8-8939b6e924f8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:15.015143 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-fbb0de3a-de1e-40ec-93c8-8939b6e924f8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:15.021710 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fbb0de3a-de1e-40ec-93c8-8939b6e924f8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:15.022165 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fbb0de3a-de1e-40ec-93c8-8939b6e924f8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:15.022955 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fbb0de3a-de1e-40ec-93c8-8939b6e924f8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:15.023463 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fbb0de3a-de1e-40ec-93c8-8939b6e924f8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:15.179267 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-fbb0de3a-de1e-40ec-93c8-8939b6e924f8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:15.188889 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-fbb0de3a-de1e-40ec-93c8-8939b6e924f8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:15.190419 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-fbb0de3a-de1e-40ec-93c8-8939b6e924f8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:15.191879 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-fbb0de3a-de1e-40ec-93c8-8939b6e924f8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.181198 Feb 08 16:47:15.192967 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 422/836] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:15 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:15.610822 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-03cd9d5c-b598-4941-8c10-6edbf241a292 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:15.611663 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-03cd9d5c-b598-4941-8c10-6edbf241a292 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:15.618877 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-03cd9d5c-b598-4941-8c10-6edbf241a292 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:15.619327 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-03cd9d5c-b598-4941-8c10-6edbf241a292 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:15.620149 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-03cd9d5c-b598-4941-8c10-6edbf241a292 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:15.620579 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-03cd9d5c-b598-4941-8c10-6edbf241a292 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:15.786684 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-03cd9d5c-b598-4941-8c10-6edbf241a292 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:15.795502 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-03cd9d5c-b598-4941-8c10-6edbf241a292 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.188174 Feb 08 16:47:15.796310 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 415/837] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:15 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:16.212044 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-89f80d6e-3ce9-41af-9873-6a82f0c8264b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:16.213291 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-89f80d6e-3ce9-41af-9873-6a82f0c8264b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:16.221109 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-89f80d6e-3ce9-41af-9873-6a82f0c8264b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:16.222542 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-89f80d6e-3ce9-41af-9873-6a82f0c8264b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:16.223977 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-89f80d6e-3ce9-41af-9873-6a82f0c8264b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:16.224496 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-89f80d6e-3ce9-41af-9873-6a82f0c8264b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:16.242217 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-3cfafa71-3f63-4b67-898e-ec4b0b19c5a6 tempest-VolumesTestJSON-1242580365 tempest-VolumesTestJSON-1242580365-project] Calling method '.version_select at 0x7fcde00bb820>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:16.331560 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-3cfafa71-3f63-4b67-898e-ec4b0b19c5a6 tempest-VolumesTestJSON-1242580365 tempest-VolumesTestJSON-1242580365-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/e2c04c26-666c-4452-bb8d-5e785bb81001" status: 200 len: 350 microversion: 2.1 time: 0.093169 Feb 08 16:47:16.338796 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 416/838] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Feb 8 16:47:16 2022] GET /compute/v2.1/os-volumes/e2c04c26-666c-4452-bb8d-5e785bb81001 => generated 350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:47:16.343952 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-54ee5e4c-c26f-4876-8b49-2bdb6a4564c7 tempest-VolumesTestJSON-1242580365 tempest-VolumesTestJSON-1242580365-project] Calling method '.version_select at 0x7fcde00bb790>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:16.413069 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-89f80d6e-3ce9-41af-9873-6a82f0c8264b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:16.422899 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-89f80d6e-3ce9-41af-9873-6a82f0c8264b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:16.425156 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-89f80d6e-3ce9-41af-9873-6a82f0c8264b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:16.426822 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-89f80d6e-3ce9-41af-9873-6a82f0c8264b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.219692 Feb 08 16:47:16.431494 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 423/839] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:16 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:16.455832 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-54ee5e4c-c26f-4876-8b49-2bdb6a4564c7 tempest-VolumesTestJSON-1242580365 tempest-VolumesTestJSON-1242580365-project] 10.222.0.35 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.115312 Feb 08 16:47:16.456428 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 417/840] 10.222.0.35 () {58 vars in 1133 bytes} [Tue Feb 8 16:47:16 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:47:16.470208 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-6f1603c6-be38-41c1-800d-c9917e638c20 tempest-VolumesTestJSON-1242580365 tempest-VolumesTestJSON-1242580365-project] Calling method '.version_select at 0x7fcde0168040>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:16.552652 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-6f1603c6-be38-41c1-800d-c9917e638c20 tempest-VolumesTestJSON-1242580365 tempest-VolumesTestJSON-1242580365-project] 10.222.0.35 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086073 Feb 08 16:47:16.553240 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 424/841] 10.222.0.35 () {58 vars in 1148 bytes} [Tue Feb 8 16:47:16 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:47:16.564590 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b550a310-2c19-43bc-9309-44511afa86ae tempest-VolumesTestJSON-1242580365 tempest-VolumesTestJSON-1242580365-project] Calling method '.version_select at 0x7fcde00cd160>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:16.649766 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-b550a310-2c19-43bc-9309-44511afa86ae tempest-VolumesTestJSON-1242580365 tempest-VolumesTestJSON-1242580365-project] 10.222.0.35 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088583 Feb 08 16:47:16.650399 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 418/842] 10.222.0.35 () {58 vars in 1133 bytes} [Tue Feb 8 16:47:16 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:16.660936 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-92f2dfc7-cb93-4a75-9706-d8ac75a065e8 tempest-VolumesTestJSON-1242580365 tempest-VolumesTestJSON-1242580365-project] Calling method '.version_select at 0x7fcde0194940>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:16.742606 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-92f2dfc7-cb93-4a75-9706-d8ac75a065e8 tempest-VolumesTestJSON-1242580365 tempest-VolumesTestJSON-1242580365-project] 10.222.0.35 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084925 Feb 08 16:47:16.743234 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 425/843] 10.222.0.35 () {58 vars in 1166 bytes} [Tue Feb 8 16:47:16 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:47:16.756021 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-2bdae356-359b-4b43-9ade-7de347ea811c tempest-VolumesTestJSON-1242580365 tempest-VolumesTestJSON-1242580365-project] Calling method '.version_select at 0x7fcde0092040>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:16.811909 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-60ba7773-f831-430e-8883-0185a79d8425 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:16.812808 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-60ba7773-f831-430e-8883-0185a79d8425 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:16.825003 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-60ba7773-f831-430e-8883-0185a79d8425 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:16.825804 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-60ba7773-f831-430e-8883-0185a79d8425 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:16.826905 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-60ba7773-f831-430e-8883-0185a79d8425 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:16.827565 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-60ba7773-f831-430e-8883-0185a79d8425 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:16.851661 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-2bdae356-359b-4b43-9ade-7de347ea811c tempest-VolumesTestJSON-1242580365 tempest-VolumesTestJSON-1242580365-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.099269 Feb 08 16:47:16.852660 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 419/844] 10.222.0.35 () {58 vars in 1169 bytes} [Tue Feb 8 16:47:16 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:47:16.866254 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-19079027-a717-4d07-b6a1-9a4824258ef9 tempest-VolumesTestJSON-1242580365 tempest-VolumesTestJSON-1242580365-project] Calling method '.version_select at 0x7fcde00bb820>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:16.953282 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-19079027-a717-4d07-b6a1-9a4824258ef9 tempest-VolumesTestJSON-1242580365 tempest-VolumesTestJSON-1242580365-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.092145 Feb 08 16:47:16.954134 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 420/845] 10.222.0.35 () {58 vars in 1154 bytes} [Tue Feb 8 16:47:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:47:16.966563 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-45a0517f-9e30-46d0-b328-28ddd191567b tempest-VolumesTestJSON-1242580365 tempest-VolumesTestJSON-1242580365-project] Calling method '.version_select at 0x7fcde00cdf70>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:16.982534 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-60ba7773-f831-430e-8883-0185a79d8425 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:16.991535 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-60ba7773-f831-430e-8883-0185a79d8425 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.183160 Feb 08 16:47:16.995797 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 426/846] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:16 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:47:17.062762 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-45a0517f-9e30-46d0-b328-28ddd191567b tempest-VolumesTestJSON-1242580365 tempest-VolumesTestJSON-1242580365-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.099835 Feb 08 16:47:17.063340 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 421/847] 10.222.0.35 () {58 vars in 1187 bytes} [Tue Feb 8 16:47:16 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:47:17.076075 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-07180498-138e-4617-8c6e-e103167b2539 tempest-VolumesTestJSON-1242580365 tempest-VolumesTestJSON-1242580365-project] Calling method '.version_select at 0x7fcde0149af0>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:17.158259 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-07180498-138e-4617-8c6e-e103167b2539 tempest-VolumesTestJSON-1242580365 tempest-VolumesTestJSON-1242580365-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086216 Feb 08 16:47:17.158839 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 427/848] 10.222.0.35 () {58 vars in 1154 bytes} [Tue Feb 8 16:47:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:17.449849 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-490ed2e0-b779-4072-af34-8044ec766147 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:17.450506 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-490ed2e0-b779-4072-af34-8044ec766147 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:17.456998 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-490ed2e0-b779-4072-af34-8044ec766147 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:17.457559 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-490ed2e0-b779-4072-af34-8044ec766147 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:17.458409 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-490ed2e0-b779-4072-af34-8044ec766147 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:17.458866 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-490ed2e0-b779-4072-af34-8044ec766147 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:17.615909 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-490ed2e0-b779-4072-af34-8044ec766147 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:17.624129 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-490ed2e0-b779-4072-af34-8044ec766147 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:17.625611 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-490ed2e0-b779-4072-af34-8044ec766147 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:17.626990 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-490ed2e0-b779-4072-af34-8044ec766147 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.181416 Feb 08 16:47:17.627549 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 422/849] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:17 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:18.009445 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-4cf1337a-a60a-42d9-8745-2c7d072ac680 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:18.010060 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-4cf1337a-a60a-42d9-8745-2c7d072ac680 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:18.017291 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4cf1337a-a60a-42d9-8745-2c7d072ac680 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:18.017732 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4cf1337a-a60a-42d9-8745-2c7d072ac680 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:18.018522 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4cf1337a-a60a-42d9-8745-2c7d072ac680 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:18.018967 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4cf1337a-a60a-42d9-8745-2c7d072ac680 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:18.157187 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-4cf1337a-a60a-42d9-8745-2c7d072ac680 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:18.165141 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-4cf1337a-a60a-42d9-8745-2c7d072ac680 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.160217 Feb 08 16:47:18.165739 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 428/850] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:18 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:18.644973 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-3bdf3159-aa14-4928-b69c-fa6279316d35 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:18.645695 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-3bdf3159-aa14-4928-b69c-fa6279316d35 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:18.653707 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3bdf3159-aa14-4928-b69c-fa6279316d35 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:18.654726 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3bdf3159-aa14-4928-b69c-fa6279316d35 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:18.656175 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3bdf3159-aa14-4928-b69c-fa6279316d35 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:18.656800 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3bdf3159-aa14-4928-b69c-fa6279316d35 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:18.823777 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-3bdf3159-aa14-4928-b69c-fa6279316d35 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:18.833061 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-3bdf3159-aa14-4928-b69c-fa6279316d35 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:18.835139 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-3bdf3159-aa14-4928-b69c-fa6279316d35 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:18.837100 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-3bdf3159-aa14-4928-b69c-fa6279316d35 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.196476 Feb 08 16:47:18.837851 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 423/851] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:18 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:19.186335 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-53bcef6b-e3bc-4a79-9c97-a92e035775f9 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:19.187400 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-53bcef6b-e3bc-4a79-9c97-a92e035775f9 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:19.196883 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-53bcef6b-e3bc-4a79-9c97-a92e035775f9 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:19.197338 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-53bcef6b-e3bc-4a79-9c97-a92e035775f9 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:19.198137 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-53bcef6b-e3bc-4a79-9c97-a92e035775f9 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:19.198579 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-53bcef6b-e3bc-4a79-9c97-a92e035775f9 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:19.339278 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-53bcef6b-e3bc-4a79-9c97-a92e035775f9 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:19.347063 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-53bcef6b-e3bc-4a79-9c97-a92e035775f9 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.167819 Feb 08 16:47:19.348307 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 429/852] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:19 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:19.855640 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-db4b2b7e-8769-4082-ab0e-32e3c63ede12 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:19.856255 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-db4b2b7e-8769-4082-ab0e-32e3c63ede12 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:19.862373 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-db4b2b7e-8769-4082-ab0e-32e3c63ede12 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:19.862826 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-db4b2b7e-8769-4082-ab0e-32e3c63ede12 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:19.863691 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-db4b2b7e-8769-4082-ab0e-32e3c63ede12 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:19.864098 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-db4b2b7e-8769-4082-ab0e-32e3c63ede12 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:20.013656 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-db4b2b7e-8769-4082-ab0e-32e3c63ede12 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:20.023790 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-db4b2b7e-8769-4082-ab0e-32e3c63ede12 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:20.025770 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-db4b2b7e-8769-4082-ab0e-32e3c63ede12 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:20.026963 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-db4b2b7e-8769-4082-ab0e-32e3c63ede12 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.175650 Feb 08 16:47:20.027928 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 424/853] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:19 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:20.364109 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-1d2a6b56-a2ea-49e4-b3b1-70a372353185 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:20.364790 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-1d2a6b56-a2ea-49e4-b3b1-70a372353185 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:20.371107 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1d2a6b56-a2ea-49e4-b3b1-70a372353185 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:20.371563 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1d2a6b56-a2ea-49e4-b3b1-70a372353185 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:20.372380 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1d2a6b56-a2ea-49e4-b3b1-70a372353185 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:20.372813 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1d2a6b56-a2ea-49e4-b3b1-70a372353185 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:20.511098 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-1d2a6b56-a2ea-49e4-b3b1-70a372353185 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:20.519819 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-1d2a6b56-a2ea-49e4-b3b1-70a372353185 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.159202 Feb 08 16:47:20.520418 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 430/854] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:20 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:21.048290 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-40a101cd-a718-4e11-8320-f9d562a5fd46 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:21.048972 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-40a101cd-a718-4e11-8320-f9d562a5fd46 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:21.060943 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-40a101cd-a718-4e11-8320-f9d562a5fd46 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:21.061696 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-40a101cd-a718-4e11-8320-f9d562a5fd46 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:21.062766 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-40a101cd-a718-4e11-8320-f9d562a5fd46 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:21.063929 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-40a101cd-a718-4e11-8320-f9d562a5fd46 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:21.389077 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-40a101cd-a718-4e11-8320-f9d562a5fd46 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:21.420568 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-40a101cd-a718-4e11-8320-f9d562a5fd46 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:21.422300 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-40a101cd-a718-4e11-8320-f9d562a5fd46 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:21.423932 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-40a101cd-a718-4e11-8320-f9d562a5fd46 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.379744 Feb 08 16:47:21.426948 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 425/855] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:21 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:21.537451 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-735290af-659e-48fe-abd3-0666770fabf2 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:21.538069 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-735290af-659e-48fe-abd3-0666770fabf2 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:21.545435 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-735290af-659e-48fe-abd3-0666770fabf2 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:21.547789 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-735290af-659e-48fe-abd3-0666770fabf2 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:21.547789 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-735290af-659e-48fe-abd3-0666770fabf2 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:21.547789 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-735290af-659e-48fe-abd3-0666770fabf2 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:21.690784 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-735290af-659e-48fe-abd3-0666770fabf2 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:21.700372 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-735290af-659e-48fe-abd3-0666770fabf2 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.166503 Feb 08 16:47:21.701156 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 431/856] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:21 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:22.442348 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-afe74f75-7c79-467c-a10c-6661424b6a80 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:22.442956 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-afe74f75-7c79-467c-a10c-6661424b6a80 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:22.450067 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-afe74f75-7c79-467c-a10c-6661424b6a80 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:22.450520 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-afe74f75-7c79-467c-a10c-6661424b6a80 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:22.451341 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-afe74f75-7c79-467c-a10c-6661424b6a80 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:22.451780 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-afe74f75-7c79-467c-a10c-6661424b6a80 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:22.717991 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-36d0a46c-3305-4ecc-879c-61848bbe5a0a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:22.718713 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-36d0a46c-3305-4ecc-879c-61848bbe5a0a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:22.725497 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-36d0a46c-3305-4ecc-879c-61848bbe5a0a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:22.726003 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-36d0a46c-3305-4ecc-879c-61848bbe5a0a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:22.726902 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-36d0a46c-3305-4ecc-879c-61848bbe5a0a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:22.727332 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-36d0a46c-3305-4ecc-879c-61848bbe5a0a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:22.875681 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-36d0a46c-3305-4ecc-879c-61848bbe5a0a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:22.884011 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-36d0a46c-3305-4ecc-879c-61848bbe5a0a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.169660 Feb 08 16:47:22.884589 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 432/857] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:22 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:47:22.907466 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-afe74f75-7c79-467c-a10c-6661424b6a80 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:22.916219 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-afe74f75-7c79-467c-a10c-6661424b6a80 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:22.917718 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-afe74f75-7c79-467c-a10c-6661424b6a80 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:22.919011 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-afe74f75-7c79-467c-a10c-6661424b6a80 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.480438 Feb 08 16:47:22.919604 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 426/858] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:22 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:23.902223 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-fb42407a-49dc-47be-a81b-35041753204a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:23.902836 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-fb42407a-49dc-47be-a81b-35041753204a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:23.909667 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb42407a-49dc-47be-a81b-35041753204a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:23.910128 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb42407a-49dc-47be-a81b-35041753204a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:23.910923 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb42407a-49dc-47be-a81b-35041753204a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:23.911368 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb42407a-49dc-47be-a81b-35041753204a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:23.939731 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b6eb7023-34f3-4e8c-8a5e-dacab0aa4327 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:23.940431 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-b6eb7023-34f3-4e8c-8a5e-dacab0aa4327 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:23.947488 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b6eb7023-34f3-4e8c-8a5e-dacab0aa4327 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:23.947970 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b6eb7023-34f3-4e8c-8a5e-dacab0aa4327 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:23.948759 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b6eb7023-34f3-4e8c-8a5e-dacab0aa4327 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:23.949196 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b6eb7023-34f3-4e8c-8a5e-dacab0aa4327 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:24.096800 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-b6eb7023-34f3-4e8c-8a5e-dacab0aa4327 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:24.106607 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-b6eb7023-34f3-4e8c-8a5e-dacab0aa4327 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:24.108453 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-b6eb7023-34f3-4e8c-8a5e-dacab0aa4327 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:24.109605 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-b6eb7023-34f3-4e8c-8a5e-dacab0aa4327 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.175631 Feb 08 16:47:24.110189 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 427/859] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:23 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:24.173911 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-fb42407a-49dc-47be-a81b-35041753204a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:24.182333 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-fb42407a-49dc-47be-a81b-35041753204a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.285390 Feb 08 16:47:24.182944 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 433/860] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:23 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:25.128221 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-7aaa7071-afcc-4519-812e-114f9af711da tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:25.129106 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7aaa7071-afcc-4519-812e-114f9af711da tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:25.136394 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7aaa7071-afcc-4519-812e-114f9af711da tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:25.136849 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7aaa7071-afcc-4519-812e-114f9af711da tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:25.137688 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7aaa7071-afcc-4519-812e-114f9af711da tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:25.138123 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7aaa7071-afcc-4519-812e-114f9af711da tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:25.199244 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-17f51a3f-951f-4071-9de0-e25e49f2dc0e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:25.199885 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-17f51a3f-951f-4071-9de0-e25e49f2dc0e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:25.206182 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-17f51a3f-951f-4071-9de0-e25e49f2dc0e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:25.206639 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-17f51a3f-951f-4071-9de0-e25e49f2dc0e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:25.207425 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-17f51a3f-951f-4071-9de0-e25e49f2dc0e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:25.207893 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-17f51a3f-951f-4071-9de0-e25e49f2dc0e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:25.346694 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-17f51a3f-951f-4071-9de0-e25e49f2dc0e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:25.354764 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-17f51a3f-951f-4071-9de0-e25e49f2dc0e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.159745 Feb 08 16:47:25.355344 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 434/861] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:25 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:47:25.374071 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7aaa7071-afcc-4519-812e-114f9af711da tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:25.383697 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7aaa7071-afcc-4519-812e-114f9af711da tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:25.385825 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7aaa7071-afcc-4519-812e-114f9af711da tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:25.387104 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-7aaa7071-afcc-4519-812e-114f9af711da tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.262843 Feb 08 16:47:25.388019 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 428/862] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:25 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:26.370604 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-775c67ec-2d86-4fba-9997-71cf77111fb5 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:26.371234 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-775c67ec-2d86-4fba-9997-71cf77111fb5 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:26.377807 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-775c67ec-2d86-4fba-9997-71cf77111fb5 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:26.378265 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-775c67ec-2d86-4fba-9997-71cf77111fb5 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:26.379048 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-775c67ec-2d86-4fba-9997-71cf77111fb5 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:26.379559 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-775c67ec-2d86-4fba-9997-71cf77111fb5 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:26.404725 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-4e4cdfb8-4914-40fb-8687-528ca43e8d84 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:26.406032 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4e4cdfb8-4914-40fb-8687-528ca43e8d84 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:26.415548 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4e4cdfb8-4914-40fb-8687-528ca43e8d84 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:26.416327 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4e4cdfb8-4914-40fb-8687-528ca43e8d84 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:26.417368 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4e4cdfb8-4914-40fb-8687-528ca43e8d84 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:26.418024 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4e4cdfb8-4914-40fb-8687-528ca43e8d84 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:26.568713 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4e4cdfb8-4914-40fb-8687-528ca43e8d84 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:26.577851 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4e4cdfb8-4914-40fb-8687-528ca43e8d84 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:26.579375 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4e4cdfb8-4914-40fb-8687-528ca43e8d84 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:26.580578 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-4e4cdfb8-4914-40fb-8687-528ca43e8d84 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.179557 Feb 08 16:47:26.581149 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 429/863] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:26 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:47:26.768280 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-775c67ec-2d86-4fba-9997-71cf77111fb5 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:26.775998 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-775c67ec-2d86-4fba-9997-71cf77111fb5 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1359 microversion: 2.1 time: 0.409548 Feb 08 16:47:26.776647 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 435/864] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:26 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1359 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:27.599482 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-0ae4f662-0686-4901-a451-0761cef6de5b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:27.600216 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-0ae4f662-0686-4901-a451-0761cef6de5b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:27.607199 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0ae4f662-0686-4901-a451-0761cef6de5b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:27.607655 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0ae4f662-0686-4901-a451-0761cef6de5b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:27.608518 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0ae4f662-0686-4901-a451-0761cef6de5b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:27.608990 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0ae4f662-0686-4901-a451-0761cef6de5b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:27.741693 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0ae4f662-0686-4901-a451-0761cef6de5b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:27.749880 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0ae4f662-0686-4901-a451-0761cef6de5b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:27.751378 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0ae4f662-0686-4901-a451-0761cef6de5b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:27.752819 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-0ae4f662-0686-4901-a451-0761cef6de5b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.157037 Feb 08 16:47:27.753384 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 430/865] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:27 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:27.792925 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-83676f62-11bf-49c2-826b-c246d8e36b4b tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:27.793646 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-83676f62-11bf-49c2-826b-c246d8e36b4b tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:27.800478 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-83676f62-11bf-49c2-826b-c246d8e36b4b tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:27.800937 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-83676f62-11bf-49c2-826b-c246d8e36b4b tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:27.801852 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-83676f62-11bf-49c2-826b-c246d8e36b4b tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:27.802322 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-83676f62-11bf-49c2-826b-c246d8e36b4b tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:27.943391 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-83676f62-11bf-49c2-826b-c246d8e36b4b tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:27.951929 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-83676f62-11bf-49c2-826b-c246d8e36b4b tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1549 microversion: 2.1 time: 0.162650 Feb 08 16:47:27.952512 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 436/866] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:27 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:47:27.969767 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d2737a5b-0ec4-4e78-bd2b-eea8f9df8e66 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:27.970378 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-d2737a5b-0ec4-4e78-bd2b-eea8f9df8e66 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:27.976353 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d2737a5b-0ec4-4e78-bd2b-eea8f9df8e66 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:27.976870 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d2737a5b-0ec4-4e78-bd2b-eea8f9df8e66 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:27.977654 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d2737a5b-0ec4-4e78-bd2b-eea8f9df8e66 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:27.978114 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d2737a5b-0ec4-4e78-bd2b-eea8f9df8e66 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:28.123035 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d2737a5b-0ec4-4e78-bd2b-eea8f9df8e66 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:28.131236 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d2737a5b-0ec4-4e78-bd2b-eea8f9df8e66 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1549 microversion: 2.1 time: 0.165274 Feb 08 16:47:28.131839 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 431/867] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:27 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:28.147858 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-6efb0934-7a01-441a-8725-eb3aa7a184d8 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:28.151359 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:47:28.151359 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:47:28.152356 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-6efb0934-7a01-441a-8725-eb3aa7a184d8 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:28.153008 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-6efb0934-7a01-441a-8725-eb3aa7a184d8 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Searching by: {'deleted': False, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09'} {{(pid=122902) get_all /opt/stack/nova/nova/compute/api.py:2908}} Feb 08 16:47:28.159390 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6efb0934-7a01-441a-8725-eb3aa7a184d8 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:28.159861 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6efb0934-7a01-441a-8725-eb3aa7a184d8 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:28.160660 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6efb0934-7a01-441a-8725-eb3aa7a184d8 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:28.161089 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6efb0934-7a01-441a-8725-eb3aa7a184d8 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:28.249520 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.multi_cell_list [None req-6efb0934-7a01-441a-8725-eb3aa7a184d8 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122902) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 08 16:47:28.342197 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-6efb0934-7a01-441a-8725-eb3aa7a184d8 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.197753 Feb 08 16:47:28.342699 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 437/868] 10.222.0.35 () {58 vars in 1124 bytes} [Tue Feb 8 16:47:28 2022] GET /compute/v2.1/servers => generated 343 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:47:28.352542 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-7499bc5c-4940-41dd-ab83-6cb1f099c970 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:28.353157 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7499bc5c-4940-41dd-ab83-6cb1f099c970 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:28.358970 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7499bc5c-4940-41dd-ab83-6cb1f099c970 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:28.359426 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7499bc5c-4940-41dd-ab83-6cb1f099c970 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:28.360239 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7499bc5c-4940-41dd-ab83-6cb1f099c970 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:28.360686 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7499bc5c-4940-41dd-ab83-6cb1f099c970 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:28.489797 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7499bc5c-4940-41dd-ab83-6cb1f099c970 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:28.497989 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-7499bc5c-4940-41dd-ab83-6cb1f099c970 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1549 microversion: 2.1 time: 0.148986 Feb 08 16:47:28.498407 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 432/869] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:28 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:28.772452 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-ccf2a779-e706-476c-a3b6-7a536ffe4b04 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:28.774560 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-ccf2a779-e706-476c-a3b6-7a536ffe4b04 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:28.782552 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ccf2a779-e706-476c-a3b6-7a536ffe4b04 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:28.783616 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ccf2a779-e706-476c-a3b6-7a536ffe4b04 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:28.784725 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ccf2a779-e706-476c-a3b6-7a536ffe4b04 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:28.785512 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ccf2a779-e706-476c-a3b6-7a536ffe4b04 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:28.941150 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ccf2a779-e706-476c-a3b6-7a536ffe4b04 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:28.950079 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ccf2a779-e706-476c-a3b6-7a536ffe4b04 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:28.951565 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ccf2a779-e706-476c-a3b6-7a536ffe4b04 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:28.952750 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-ccf2a779-e706-476c-a3b6-7a536ffe4b04 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.185106 Feb 08 16:47:28.953332 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 438/870] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:28 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:29.378375 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 16:47:29.378542 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: Tue Feb 8 16:47:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 16:47:29.970556 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e80a1a4a-45e4-4bd9-a12d-4780b7c693c8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:29.971426 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e80a1a4a-45e4-4bd9-a12d-4780b7c693c8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:29.978658 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e80a1a4a-45e4-4bd9-a12d-4780b7c693c8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:29.979184 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e80a1a4a-45e4-4bd9-a12d-4780b7c693c8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:29.980144 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e80a1a4a-45e4-4bd9-a12d-4780b7c693c8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:29.980677 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e80a1a4a-45e4-4bd9-a12d-4780b7c693c8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:30.009174 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-030e1463-9ff1-41eb-86ba-e1c00eff9c9d tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88ccf384-a333-41c5-be44-751a7d1549f4"}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:47:30.010973 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-030e1463-9ff1-41eb-86ba-e1c00eff9c9d tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:30.018618 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-030e1463-9ff1-41eb-86ba-e1c00eff9c9d tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:30.019170 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-030e1463-9ff1-41eb-86ba-e1c00eff9c9d tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:30.020100 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-030e1463-9ff1-41eb-86ba-e1c00eff9c9d tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:30.020756 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-030e1463-9ff1-41eb-86ba-e1c00eff9c9d tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:30.153813 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e80a1a4a-45e4-4bd9-a12d-4780b7c693c8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:30.167005 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e80a1a4a-45e4-4bd9-a12d-4780b7c693c8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:30.171837 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e80a1a4a-45e4-4bd9-a12d-4780b7c693c8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:30.174008 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e80a1a4a-45e4-4bd9-a12d-4780b7c693c8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.207026 Feb 08 16:47:30.175396 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 433/871] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:29 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:30.449829 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-030e1463-9ff1-41eb-86ba-e1c00eff9c9d tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "POST /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.444627 Feb 08 16:47:30.450451 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 439/872] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Feb 8 16:47:30 2022] POST /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3/os-volume_attachments => generated 194 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:47:31.204364 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-4a53d1db-f943-451a-8ffb-defb13a3ae98 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:31.204963 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4a53d1db-f943-451a-8ffb-defb13a3ae98 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:31.211511 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4a53d1db-f943-451a-8ffb-defb13a3ae98 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:31.211996 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4a53d1db-f943-451a-8ffb-defb13a3ae98 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:31.212784 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4a53d1db-f943-451a-8ffb-defb13a3ae98 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:31.213241 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4a53d1db-f943-451a-8ffb-defb13a3ae98 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:31.382688 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4a53d1db-f943-451a-8ffb-defb13a3ae98 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:31.391377 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4a53d1db-f943-451a-8ffb-defb13a3ae98 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:31.393007 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4a53d1db-f943-451a-8ffb-defb13a3ae98 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:31.394241 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-4a53d1db-f943-451a-8ffb-defb13a3ae98 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.193783 Feb 08 16:47:31.394821 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 434/873] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:31 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:32.413292 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-71b0ba8d-77dc-461e-ae34-7e03a70cb146 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:32.413958 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-71b0ba8d-77dc-461e-ae34-7e03a70cb146 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:32.420477 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-71b0ba8d-77dc-461e-ae34-7e03a70cb146 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:32.420996 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-71b0ba8d-77dc-461e-ae34-7e03a70cb146 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:32.421837 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-71b0ba8d-77dc-461e-ae34-7e03a70cb146 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:32.422340 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-71b0ba8d-77dc-461e-ae34-7e03a70cb146 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:32.561720 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-71b0ba8d-77dc-461e-ae34-7e03a70cb146 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:32.573750 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-71b0ba8d-77dc-461e-ae34-7e03a70cb146 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:32.573750 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-71b0ba8d-77dc-461e-ae34-7e03a70cb146 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:32.574216 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-71b0ba8d-77dc-461e-ae34-7e03a70cb146 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.165398 Feb 08 16:47:32.582491 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 440/874] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:32 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:33.592372 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-14fbefac-ec1e-41e9-a957-4cc64ad6c29b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:33.593071 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-14fbefac-ec1e-41e9-a957-4cc64ad6c29b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:33.599323 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-14fbefac-ec1e-41e9-a957-4cc64ad6c29b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:33.600016 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-14fbefac-ec1e-41e9-a957-4cc64ad6c29b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:33.601680 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-14fbefac-ec1e-41e9-a957-4cc64ad6c29b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:33.602540 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-14fbefac-ec1e-41e9-a957-4cc64ad6c29b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:33.746583 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-14fbefac-ec1e-41e9-a957-4cc64ad6c29b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:33.754944 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-14fbefac-ec1e-41e9-a957-4cc64ad6c29b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:33.756619 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-14fbefac-ec1e-41e9-a957-4cc64ad6c29b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:33.758818 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-14fbefac-ec1e-41e9-a957-4cc64ad6c29b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.170114 Feb 08 16:47:33.759395 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 435/875] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:33 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:34.778612 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c9dcdc9d-82b5-426e-ab56-fec888215114 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:34.779228 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c9dcdc9d-82b5-426e-ab56-fec888215114 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:34.785743 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c9dcdc9d-82b5-426e-ab56-fec888215114 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:34.786201 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c9dcdc9d-82b5-426e-ab56-fec888215114 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:34.787027 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c9dcdc9d-82b5-426e-ab56-fec888215114 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:34.787464 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c9dcdc9d-82b5-426e-ab56-fec888215114 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:34.925314 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c9dcdc9d-82b5-426e-ab56-fec888215114 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:34.935033 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c9dcdc9d-82b5-426e-ab56-fec888215114 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:34.936580 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c9dcdc9d-82b5-426e-ab56-fec888215114 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:34.937738 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c9dcdc9d-82b5-426e-ab56-fec888215114 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.162997 Feb 08 16:47:34.938366 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 441/876] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:34 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:35.956880 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-0d1d4a04-5860-4012-aec1-820c2504ae3c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:35.957338 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-0d1d4a04-5860-4012-aec1-820c2504ae3c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:35.965113 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0d1d4a04-5860-4012-aec1-820c2504ae3c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:35.965650 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0d1d4a04-5860-4012-aec1-820c2504ae3c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:35.966686 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0d1d4a04-5860-4012-aec1-820c2504ae3c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:35.967144 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0d1d4a04-5860-4012-aec1-820c2504ae3c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:36.106843 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0d1d4a04-5860-4012-aec1-820c2504ae3c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:36.115026 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0d1d4a04-5860-4012-aec1-820c2504ae3c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:36.116544 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0d1d4a04-5860-4012-aec1-820c2504ae3c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:36.117960 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-0d1d4a04-5860-4012-aec1-820c2504ae3c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.165146 Feb 08 16:47:36.118719 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 436/877] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:35 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:37.135716 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-aff9c96a-b21d-4423-aa0c-8ec845e8ea57 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:37.136515 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-aff9c96a-b21d-4423-aa0c-8ec845e8ea57 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:37.143831 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-aff9c96a-b21d-4423-aa0c-8ec845e8ea57 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:37.144491 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-aff9c96a-b21d-4423-aa0c-8ec845e8ea57 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:37.145369 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-aff9c96a-b21d-4423-aa0c-8ec845e8ea57 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:37.145930 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-aff9c96a-b21d-4423-aa0c-8ec845e8ea57 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:37.287502 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-aff9c96a-b21d-4423-aa0c-8ec845e8ea57 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:37.296372 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-aff9c96a-b21d-4423-aa0c-8ec845e8ea57 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:37.297876 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-aff9c96a-b21d-4423-aa0c-8ec845e8ea57 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:37.299015 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-aff9c96a-b21d-4423-aa0c-8ec845e8ea57 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.167454 Feb 08 16:47:37.299568 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 442/878] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:37 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:37.881876 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-3dc89f24-7e74-47e3-8dff-f20863f17abe tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-516211558", "imageRef": "d70d3911-14f2-4cba-9283-bf4bef4fb526", "flavorRef": "452", "networks": [{"uuid": "6eff03a1-c6a7-4619-8332-f7ea53ea50ca"}]}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:47:37.949785 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.network.neutron [None req-3dc89f24-7e74-47e3-8dff-f20863f17abe tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] validate_networks() for [('6eff03a1-c6a7-4619-8332-f7ea53ea50ca', None, None, None, None, None)] {{(pid=122901) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 16:47:38.020571 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-daf8a849-6586-4e0d-8006-845074b34b80 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:38.021194 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-daf8a849-6586-4e0d-8006-845074b34b80 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:38.027769 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-daf8a849-6586-4e0d-8006-845074b34b80 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:38.028231 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-daf8a849-6586-4e0d-8006-845074b34b80 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:38.029047 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-daf8a849-6586-4e0d-8006-845074b34b80 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:38.029485 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-daf8a849-6586-4e0d-8006-845074b34b80 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:38.168445 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-daf8a849-6586-4e0d-8006-845074b34b80 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:38.176483 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-daf8a849-6586-4e0d-8006-845074b34b80 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1595 microversion: 2.1 time: 0.159861 Feb 08 16:47:38.177056 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 443/879] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:38 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1595 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:47:38.317145 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-84d74c87-46fa-4a98-aa06-c7eb45133ea3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:38.317915 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-84d74c87-46fa-4a98-aa06-c7eb45133ea3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:38.318908 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-3dc89f24-7e74-47e3-8dff-f20863f17abe tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Flavor limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 16:47:38.319337 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-3dc89f24-7e74-47e3-8dff-f20863f17abe tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Image limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 16:47:38.319883 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-3dc89f24-7e74-47e3-8dff-f20863f17abe tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Flavor pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 16:47:38.320892 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-3dc89f24-7e74-47e3-8dff-f20863f17abe tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Image pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 16:47:38.321312 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-3dc89f24-7e74-47e3-8dff-f20863f17abe tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 16:47:38.327670 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-84d74c87-46fa-4a98-aa06-c7eb45133ea3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:38.328267 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-84d74c87-46fa-4a98-aa06-c7eb45133ea3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:38.329292 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-84d74c87-46fa-4a98-aa06-c7eb45133ea3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:38.330101 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-84d74c87-46fa-4a98-aa06-c7eb45133ea3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:38.330219 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3dc89f24-7e74-47e3-8dff-f20863f17abe tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:38.330557 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3dc89f24-7e74-47e3-8dff-f20863f17abe tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:38.331375 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3dc89f24-7e74-47e3-8dff-f20863f17abe tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:38.331835 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3dc89f24-7e74-47e3-8dff-f20863f17abe tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:38.349463 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-3dc89f24-7e74-47e3-8dff-f20863f17abe tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Getting quotas for project 4628b38b90b6499e97fe1045b54098f8. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:47:38.354296 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-3dc89f24-7e74-47e3-8dff-f20863f17abe tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Getting quotas for user 2b96d3350af145ac8a7805eacfd8b246 and project 4628b38b90b6499e97fe1045b54098f8. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:47:38.369037 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-3dc89f24-7e74-47e3-8dff-f20863f17abe tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Going to run 1 instances... {{(pid=122901) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 16:47:38.371355 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-3dc89f24-7e74-47e3-8dff-f20863f17abe tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: 6940d26f-8e1f-4189-b305-e0277d3659e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d70d3911-14f2-4cba-9283-bf4bef4fb526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122901) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 16:47:38.424793 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-3dc89f24-7e74-47e3-8dff-f20863f17abe tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546457 Feb 08 16:47:38.427792 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 437/880] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Feb 8 16:47:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 16:47:38.435864 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ca24c12f-50b9-4184-8b09-b2413e9eaab6 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:38.436731 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-ca24c12f-50b9-4184-8b09-b2413e9eaab6 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: 6940d26f-8e1f-4189-b305-e0277d3659e2] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:38.499076 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ca24c12f-50b9-4184-8b09-b2413e9eaab6 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:38.511596 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-ca24c12f-50b9-4184-8b09-b2413e9eaab6 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2" status: 200 len: 1213 microversion: 2.1 time: 0.078972 Feb 08 16:47:38.512853 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 438/881] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:38 2022] GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:47:38.566950 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-84d74c87-46fa-4a98-aa06-c7eb45133ea3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:38.587459 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-84d74c87-46fa-4a98-aa06-c7eb45133ea3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:38.590269 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-84d74c87-46fa-4a98-aa06-c7eb45133ea3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:38.593858 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-84d74c87-46fa-4a98-aa06-c7eb45133ea3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.280867 Feb 08 16:47:38.605963 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 444/882] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:38 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:38.723207 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-a98c165e-631c-48c9-ab91-8b609b09918f req-53f5a55e-1a98-47d8-838d-c422f969201d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da00c476-8246-413e-889c-d22fe63e2ef8", "name": "network-vif-plugged", "status": "completed", "tag": "dc601835-5363-4bdf-9b05-9e711057cbd2"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:47:38.724839 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:47:38.724839 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:47:38.732380 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-a98c165e-631c-48c9-ab91-8b609b09918f req-53f5a55e-1a98-47d8-838d-c422f969201d service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:38.732832 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-a98c165e-631c-48c9-ab91-8b609b09918f req-53f5a55e-1a98-47d8-838d-c422f969201d service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:38.744867 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-a98c165e-631c-48c9-ab91-8b609b09918f req-53f5a55e-1a98-47d8-838d-c422f969201d service nova] Creating event network-vif-plugged:dc601835-5363-4bdf-9b05-9e711057cbd2 for instance da00c476-8246-413e-889c-d22fe63e2ef8 on hv-cinder-82786 Feb 08 16:47:38.750705 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-a98c165e-631c-48c9-ab91-8b609b09918f req-53f5a55e-1a98-47d8-838d-c422f969201d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185020 Feb 08 16:47:38.752103 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 439/883] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:47:39.529129 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e1d6f3dc-90d0-4c8f-a2ef-8b07b95aa833 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:39.529892 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e1d6f3dc-90d0-4c8f-a2ef-8b07b95aa833 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: 6940d26f-8e1f-4189-b305-e0277d3659e2] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:39.536272 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e1d6f3dc-90d0-4c8f-a2ef-8b07b95aa833 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:39.536726 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e1d6f3dc-90d0-4c8f-a2ef-8b07b95aa833 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:39.537505 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e1d6f3dc-90d0-4c8f-a2ef-8b07b95aa833 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:39.537937 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e1d6f3dc-90d0-4c8f-a2ef-8b07b95aa833 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:39.617166 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-c4069bc9-32b9-4fcf-b3b6-13e21dd3a73f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:39.618824 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-c4069bc9-32b9-4fcf-b3b6-13e21dd3a73f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:39.625318 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c4069bc9-32b9-4fcf-b3b6-13e21dd3a73f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:39.626002 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c4069bc9-32b9-4fcf-b3b6-13e21dd3a73f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:39.627389 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c4069bc9-32b9-4fcf-b3b6-13e21dd3a73f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:39.628045 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c4069bc9-32b9-4fcf-b3b6-13e21dd3a73f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:39.655165 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e1d6f3dc-90d0-4c8f-a2ef-8b07b95aa833 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:39.677306 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e1d6f3dc-90d0-4c8f-a2ef-8b07b95aa833 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2" status: 200 len: 1273 microversion: 2.1 time: 0.152032 Feb 08 16:47:39.678121 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 445/884] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:39 2022] GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2 => generated 1273 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:39.902419 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c4069bc9-32b9-4fcf-b3b6-13e21dd3a73f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:39.919356 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c4069bc9-32b9-4fcf-b3b6-13e21dd3a73f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:39.922297 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c4069bc9-32b9-4fcf-b3b6-13e21dd3a73f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:39.923145 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-c4069bc9-32b9-4fcf-b3b6-13e21dd3a73f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.311575 Feb 08 16:47:39.923980 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 440/885] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:39 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:47:40.617876 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-ccc5f0be-93a7-4750-912f-0b333dcadcf3 req-076faaa6-e45b-400f-b267-5e1a8205e012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b3f77f-d45a-4763-8843-929d858a24a3", "tag": "ef3eb329-986b-442c-9350-fab47f0d2892"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:47:40.619842 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:47:40.619842 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:47:40.635625 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-ccc5f0be-93a7-4750-912f-0b333dcadcf3 req-076faaa6-e45b-400f-b267-5e1a8205e012 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:40.636109 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-ccc5f0be-93a7-4750-912f-0b333dcadcf3 req-076faaa6-e45b-400f-b267-5e1a8205e012 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:40.652809 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-ccc5f0be-93a7-4750-912f-0b333dcadcf3 req-076faaa6-e45b-400f-b267-5e1a8205e012 service nova] Creating event network-changed:ef3eb329-986b-442c-9350-fab47f0d2892 for instance 20b3f77f-d45a-4763-8843-929d858a24a3 on hv-cinder-82786 Feb 08 16:47:40.657934 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-ccc5f0be-93a7-4750-912f-0b333dcadcf3 req-076faaa6-e45b-400f-b267-5e1a8205e012 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.390341 Feb 08 16:47:40.658681 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 446/886] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:47:40.694255 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-cabbdab7-3dda-4654-9750-32b09bdeb10d tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:40.696112 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-cabbdab7-3dda-4654-9750-32b09bdeb10d tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: 6940d26f-8e1f-4189-b305-e0277d3659e2] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:40.705811 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cabbdab7-3dda-4654-9750-32b09bdeb10d tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:40.706265 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cabbdab7-3dda-4654-9750-32b09bdeb10d tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:40.707258 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cabbdab7-3dda-4654-9750-32b09bdeb10d tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:40.707893 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cabbdab7-3dda-4654-9750-32b09bdeb10d tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:40.941828 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b49fd38a-c28a-4d5f-9272-888c1824ab35 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:40.942926 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b49fd38a-c28a-4d5f-9272-888c1824ab35 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:40.955423 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b49fd38a-c28a-4d5f-9272-888c1824ab35 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:40.957685 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b49fd38a-c28a-4d5f-9272-888c1824ab35 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:40.958366 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b49fd38a-c28a-4d5f-9272-888c1824ab35 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:40.958809 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b49fd38a-c28a-4d5f-9272-888c1824ab35 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:41.036172 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-cabbdab7-3dda-4654-9750-32b09bdeb10d tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:41.054112 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-cabbdab7-3dda-4654-9750-32b09bdeb10d tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2" status: 200 len: 1313 microversion: 2.1 time: 0.361527 Feb 08 16:47:41.066951 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 441/887] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:40 2022] GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2 => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:41.403627 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b49fd38a-c28a-4d5f-9272-888c1824ab35 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:41.417612 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b49fd38a-c28a-4d5f-9272-888c1824ab35 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:41.420544 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b49fd38a-c28a-4d5f-9272-888c1824ab35 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:41.421198 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b49fd38a-c28a-4d5f-9272-888c1824ab35 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1807 microversion: 2.20 time: 0.483340 Feb 08 16:47:41.427898 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 447/888] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:40 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1807 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:47:41.918487 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-c2d5f6bd-80b5-43cd-926b-a562163958ab req-067dedec-2898-4c7a-a9b1-c2e30dc3f335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6940d26f-8e1f-4189-b305-e0277d3659e2", "tag": "d77445df-5602-4b5d-9e58-7ecee7e53ac4"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:47:41.921817 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:47:41.921817 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:47:41.933300 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-c2d5f6bd-80b5-43cd-926b-a562163958ab req-067dedec-2898-4c7a-a9b1-c2e30dc3f335 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:41.934167 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-c2d5f6bd-80b5-43cd-926b-a562163958ab req-067dedec-2898-4c7a-a9b1-c2e30dc3f335 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:41.970932 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-c2d5f6bd-80b5-43cd-926b-a562163958ab req-067dedec-2898-4c7a-a9b1-c2e30dc3f335 service nova] Creating event network-changed:d77445df-5602-4b5d-9e58-7ecee7e53ac4 for instance 6940d26f-8e1f-4189-b305-e0277d3659e2 on hv-cinder-82786 Feb 08 16:47:41.978759 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-c2d5f6bd-80b5-43cd-926b-a562163958ab req-067dedec-2898-4c7a-a9b1-c2e30dc3f335 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064553 Feb 08 16:47:41.979376 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 442/889] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:47:42.073274 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-d32264ad-11af-4383-98c0-825155f38b0d tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:42.073891 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-d32264ad-11af-4383-98c0-825155f38b0d tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: 6940d26f-8e1f-4189-b305-e0277d3659e2] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:42.080646 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d32264ad-11af-4383-98c0-825155f38b0d tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:42.081108 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d32264ad-11af-4383-98c0-825155f38b0d tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:42.081901 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d32264ad-11af-4383-98c0-825155f38b0d tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:42.082342 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d32264ad-11af-4383-98c0-825155f38b0d tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:42.226331 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-d32264ad-11af-4383-98c0-825155f38b0d tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:42.236210 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-d32264ad-11af-4383-98c0-825155f38b0d tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2" status: 200 len: 1313 microversion: 2.1 time: 0.166465 Feb 08 16:47:42.237015 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 448/890] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:42 2022] GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:42.294654 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-4d9aeb1f-1bab-4fd4-a3a4-2a4a29a0784c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1756152615"}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:47:42.295269 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4d9aeb1f-1bab-4fd4-a3a4-2a4a29a0784c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:42.301491 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4d9aeb1f-1bab-4fd4-a3a4-2a4a29a0784c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:42.301951 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4d9aeb1f-1bab-4fd4-a3a4-2a4a29a0784c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:42.302761 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4d9aeb1f-1bab-4fd4-a3a4-2a4a29a0784c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:42.303200 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4d9aeb1f-1bab-4fd4-a3a4-2a4a29a0784c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:42.444919 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-d120fa18-7bcb-4e71-9e17-c11fe42d455b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:42.446268 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-d120fa18-7bcb-4e71-9e17-c11fe42d455b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:42.452192 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d120fa18-7bcb-4e71-9e17-c11fe42d455b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:42.452650 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d120fa18-7bcb-4e71-9e17-c11fe42d455b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:42.453447 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d120fa18-7bcb-4e71-9e17-c11fe42d455b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:42.453890 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d120fa18-7bcb-4e71-9e17-c11fe42d455b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:42.534536 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.network.security_group_api [None req-4d9aeb1f-1bab-4fd4-a3a4-2a4a29a0784c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Adding security group 9e910800-aedc-4562-ad89-cc5596917dbc to port ef3eb329-986b-442c-9350-fab47f0d2892 Feb 08 16:47:42.602757 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-d120fa18-7bcb-4e71-9e17-c11fe42d455b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:42.612836 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-d120fa18-7bcb-4e71-9e17-c11fe42d455b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:42.614310 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-d120fa18-7bcb-4e71-9e17-c11fe42d455b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:42.615604 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-d120fa18-7bcb-4e71-9e17-c11fe42d455b tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1794 microversion: 2.20 time: 0.174442 Feb 08 16:47:42.616326 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 449/891] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:47:42 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1794 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:47:43.255290 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-35204811-a889-47f1-a897-0ed5a66eade2 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:43.257996 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-35204811-a889-47f1-a897-0ed5a66eade2 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: 6940d26f-8e1f-4189-b305-e0277d3659e2] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:43.276732 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-35204811-a889-47f1-a897-0ed5a66eade2 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:43.278075 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-35204811-a889-47f1-a897-0ed5a66eade2 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:43.279509 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-35204811-a889-47f1-a897-0ed5a66eade2 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:43.280857 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-35204811-a889-47f1-a897-0ed5a66eade2 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:43.413445 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-4d9aeb1f-1bab-4fd4-a3a4-2a4a29a0784c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "POST /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3/action" status: 202 len: 0 microversion: 2.1 time: 1.122792 Feb 08 16:47:43.414918 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 443/892] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Feb 8 16:47:42 2022] POST /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3/action => generated 0 bytes in 1125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:47:43.422689 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-fa6b754a-1927-4e87-8e2f-323ecbc4c930 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:43.424016 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-fa6b754a-1927-4e87-8e2f-323ecbc4c930 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:43.430836 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fa6b754a-1927-4e87-8e2f-323ecbc4c930 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:43.431632 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fa6b754a-1927-4e87-8e2f-323ecbc4c930 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:43.432666 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fa6b754a-1927-4e87-8e2f-323ecbc4c930 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:43.433310 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fa6b754a-1927-4e87-8e2f-323ecbc4c930 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:43.531734 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-35204811-a889-47f1-a897-0ed5a66eade2 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:43.539338 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-35204811-a889-47f1-a897-0ed5a66eade2 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2" status: 200 len: 1313 microversion: 2.1 time: 0.289069 Feb 08 16:47:43.540514 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 450/893] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:43 2022] GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:43.700428 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-fa6b754a-1927-4e87-8e2f-323ecbc4c930 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:43.708873 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-fa6b754a-1927-4e87-8e2f-323ecbc4c930 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1761 microversion: 2.1 time: 0.289186 Feb 08 16:47:43.709754 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 444/894] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:43 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1761 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:47:43.999052 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-ad8cb0b6-45fb-4409-9aca-8164d4f18e8c req-1f9716c8-462f-4569-bcd6-f20f3cd4939a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b3f77f-d45a-4763-8843-929d858a24a3", "tag": "ef3eb329-986b-442c-9350-fab47f0d2892"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:47:44.000623 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:47:44.000623 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:47:44.007647 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-ad8cb0b6-45fb-4409-9aca-8164d4f18e8c req-1f9716c8-462f-4569-bcd6-f20f3cd4939a service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:44.008157 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-ad8cb0b6-45fb-4409-9aca-8164d4f18e8c req-1f9716c8-462f-4569-bcd6-f20f3cd4939a service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:44.018690 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-ad8cb0b6-45fb-4409-9aca-8164d4f18e8c req-1f9716c8-462f-4569-bcd6-f20f3cd4939a service nova] Creating event network-changed:ef3eb329-986b-442c-9350-fab47f0d2892 for instance 20b3f77f-d45a-4763-8843-929d858a24a3 on hv-cinder-82786 Feb 08 16:47:44.023938 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-ad8cb0b6-45fb-4409-9aca-8164d4f18e8c req-1f9716c8-462f-4569-bcd6-f20f3cd4939a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027986 Feb 08 16:47:44.024513 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 451/895] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:47:44.556576 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-5b6bd56d-542e-4349-95be-53e29f8ea216 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:44.557312 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-5b6bd56d-542e-4349-95be-53e29f8ea216 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: 6940d26f-8e1f-4189-b305-e0277d3659e2] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:44.563688 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5b6bd56d-542e-4349-95be-53e29f8ea216 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:44.564227 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5b6bd56d-542e-4349-95be-53e29f8ea216 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:44.565072 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5b6bd56d-542e-4349-95be-53e29f8ea216 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:44.565563 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5b6bd56d-542e-4349-95be-53e29f8ea216 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:44.699609 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-5b6bd56d-542e-4349-95be-53e29f8ea216 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:44.706801 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-5b6bd56d-542e-4349-95be-53e29f8ea216 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2" status: 200 len: 1313 microversion: 2.1 time: 0.154631 Feb 08 16:47:44.707371 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 445/896] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:44 2022] GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:45.724836 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b2752404-8c7a-4ae9-8248-eef3916d82a3 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:45.725533 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b2752404-8c7a-4ae9-8248-eef3916d82a3 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: 6940d26f-8e1f-4189-b305-e0277d3659e2] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:45.732162 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b2752404-8c7a-4ae9-8248-eef3916d82a3 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:45.732618 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b2752404-8c7a-4ae9-8248-eef3916d82a3 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:45.733395 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b2752404-8c7a-4ae9-8248-eef3916d82a3 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:45.733836 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b2752404-8c7a-4ae9-8248-eef3916d82a3 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:45.870166 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b2752404-8c7a-4ae9-8248-eef3916d82a3 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:45.877665 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b2752404-8c7a-4ae9-8248-eef3916d82a3 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2" status: 200 len: 1313 microversion: 2.1 time: 0.157468 Feb 08 16:47:45.878229 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 452/897] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:45 2022] GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:46.583025 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-b53c7d5f-5711-46ae-a89e-bd1f6191d7c8 req-86b6a83c-7cb6-4af5-947f-4b147a15a54c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6940d26f-8e1f-4189-b305-e0277d3659e2", "name": "network-vif-plugged", "status": "completed", "tag": "d77445df-5602-4b5d-9e58-7ecee7e53ac4"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:47:46.584644 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:47:46.584644 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:47:46.593384 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-b53c7d5f-5711-46ae-a89e-bd1f6191d7c8 req-86b6a83c-7cb6-4af5-947f-4b147a15a54c service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:46.593867 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-b53c7d5f-5711-46ae-a89e-bd1f6191d7c8 req-86b6a83c-7cb6-4af5-947f-4b147a15a54c service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:46.604918 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-b53c7d5f-5711-46ae-a89e-bd1f6191d7c8 req-86b6a83c-7cb6-4af5-947f-4b147a15a54c service nova] Creating event network-vif-plugged:d77445df-5602-4b5d-9e58-7ecee7e53ac4 for instance 6940d26f-8e1f-4189-b305-e0277d3659e2 on hv-cinder-82786 Feb 08 16:47:46.609538 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-b53c7d5f-5711-46ae-a89e-bd1f6191d7c8 req-86b6a83c-7cb6-4af5-947f-4b147a15a54c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030714 Feb 08 16:47:46.610306 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 446/898] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:47:46.893956 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-9a9dfe41-30ef-49e5-a8aa-1b21273efcab tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:46.894573 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-9a9dfe41-30ef-49e5-a8aa-1b21273efcab tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: 6940d26f-8e1f-4189-b305-e0277d3659e2] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:46.901003 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9a9dfe41-30ef-49e5-a8aa-1b21273efcab tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:46.901460 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9a9dfe41-30ef-49e5-a8aa-1b21273efcab tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:46.902246 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9a9dfe41-30ef-49e5-a8aa-1b21273efcab tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:46.902686 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9a9dfe41-30ef-49e5-a8aa-1b21273efcab tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:47.033370 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9a9dfe41-30ef-49e5-a8aa-1b21273efcab tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:47.040820 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-9a9dfe41-30ef-49e5-a8aa-1b21273efcab tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2" status: 200 len: 1313 microversion: 2.1 time: 0.150567 Feb 08 16:47:47.041402 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 453/899] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:46 2022] GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:48.057820 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-49fcb3a3-a80c-4a66-a3f6-d91b9307ded5 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:48.058521 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-49fcb3a3-a80c-4a66-a3f6-d91b9307ded5 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: 6940d26f-8e1f-4189-b305-e0277d3659e2] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:48.064642 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-49fcb3a3-a80c-4a66-a3f6-d91b9307ded5 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:48.065090 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-49fcb3a3-a80c-4a66-a3f6-d91b9307ded5 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:48.065863 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-49fcb3a3-a80c-4a66-a3f6-d91b9307ded5 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:48.066296 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-49fcb3a3-a80c-4a66-a3f6-d91b9307ded5 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:48.200615 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-49fcb3a3-a80c-4a66-a3f6-d91b9307ded5 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:48.207872 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-49fcb3a3-a80c-4a66-a3f6-d91b9307ded5 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2" status: 200 len: 1313 microversion: 2.1 time: 0.154420 Feb 08 16:47:48.208458 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 447/900] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:48 2022] GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:49.224839 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-af4be157-448f-4677-956c-42594be70e55 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:49.225448 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-af4be157-448f-4677-956c-42594be70e55 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: 6940d26f-8e1f-4189-b305-e0277d3659e2] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:49.232500 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-af4be157-448f-4677-956c-42594be70e55 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:49.232986 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-af4be157-448f-4677-956c-42594be70e55 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:49.233918 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-af4be157-448f-4677-956c-42594be70e55 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:49.234372 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-af4be157-448f-4677-956c-42594be70e55 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:49.367797 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-af4be157-448f-4677-956c-42594be70e55 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:49.374985 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-af4be157-448f-4677-956c-42594be70e55 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2" status: 200 len: 1497 microversion: 2.1 time: 0.153802 Feb 08 16:47:49.375554 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 454/901] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:49 2022] GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2 => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:49.766510 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-4ee6c464-0f47-42f3-b5c5-a883c4635ac6 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:49.767017 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4ee6c464-0f47-42f3-b5c5-a883c4635ac6 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: 6940d26f-8e1f-4189-b305-e0277d3659e2] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:49.773665 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4ee6c464-0f47-42f3-b5c5-a883c4635ac6 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:49.774122 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4ee6c464-0f47-42f3-b5c5-a883c4635ac6 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:49.774898 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4ee6c464-0f47-42f3-b5c5-a883c4635ac6 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:49.775368 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4ee6c464-0f47-42f3-b5c5-a883c4635ac6 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:49.798739 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4ee6c464-0f47-42f3-b5c5-a883c4635ac6 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: 6940d26f-8e1f-4189-b305-e0277d3659e2] Going to try to terminate instance {{(pid=122901) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 16:47:49.870117 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-4ee6c464-0f47-42f3-b5c5-a883c4635ac6 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "DELETE /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2" status: 204 len: 0 microversion: 2.1 time: 0.107067 Feb 08 16:47:49.870709 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 448/902] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Feb 8 16:47:49 2022] DELETE /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 16:47:49.880463 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-386795cf-5625-455f-b0da-3c87de76f75b tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:49.881103 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-386795cf-5625-455f-b0da-3c87de76f75b tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: 6940d26f-8e1f-4189-b305-e0277d3659e2] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:49.888421 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-386795cf-5625-455f-b0da-3c87de76f75b tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:49.888864 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-386795cf-5625-455f-b0da-3c87de76f75b tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:49.889645 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-386795cf-5625-455f-b0da-3c87de76f75b tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:49.890077 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-386795cf-5625-455f-b0da-3c87de76f75b tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:50.025231 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-386795cf-5625-455f-b0da-3c87de76f75b tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:50.032504 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-386795cf-5625-455f-b0da-3c87de76f75b tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2" status: 200 len: 1503 microversion: 2.1 time: 0.157314 Feb 08 16:47:50.033064 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 455/903] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:49 2022] GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:51.050504 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-02ef97d6-3d49-41c8-9b18-159dd775b38f tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:51.051229 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-02ef97d6-3d49-41c8-9b18-159dd775b38f tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: 6940d26f-8e1f-4189-b305-e0277d3659e2] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:51.057642 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-02ef97d6-3d49-41c8-9b18-159dd775b38f tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:51.058090 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-02ef97d6-3d49-41c8-9b18-159dd775b38f tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:51.058948 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-02ef97d6-3d49-41c8-9b18-159dd775b38f tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:51.059387 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-02ef97d6-3d49-41c8-9b18-159dd775b38f tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:51.191604 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-02ef97d6-3d49-41c8-9b18-159dd775b38f tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:51.199592 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-02ef97d6-3d49-41c8-9b18-159dd775b38f tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2" status: 200 len: 1503 microversion: 2.1 time: 0.153049 Feb 08 16:47:51.200219 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 449/904] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:51 2022] GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:51.872432 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-10651710-aa72-48a1-a6c0-f5bf8adfa70a req-21b6788b-7ff2-4de7-97a0-b33219065bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6940d26f-8e1f-4189-b305-e0277d3659e2", "name": "network-vif-deleted", "tag": "d77445df-5602-4b5d-9e58-7ecee7e53ac4"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:47:51.873960 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:47:51.873960 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:47:51.881775 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-10651710-aa72-48a1-a6c0-f5bf8adfa70a req-21b6788b-7ff2-4de7-97a0-b33219065bb4 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:51.883577 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-10651710-aa72-48a1-a6c0-f5bf8adfa70a req-21b6788b-7ff2-4de7-97a0-b33219065bb4 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:51.894266 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-10651710-aa72-48a1-a6c0-f5bf8adfa70a req-21b6788b-7ff2-4de7-97a0-b33219065bb4 service nova] Creating event network-vif-deleted:d77445df-5602-4b5d-9e58-7ecee7e53ac4 for instance 6940d26f-8e1f-4189-b305-e0277d3659e2 on hv-cinder-82786 Feb 08 16:47:51.900395 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-10651710-aa72-48a1-a6c0-f5bf8adfa70a req-21b6788b-7ff2-4de7-97a0-b33219065bb4 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031420 Feb 08 16:47:51.900970 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 456/905] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:47:52.216854 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-a03d362b-343c-4472-a919-24f040a5a7d8 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:52.217482 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-a03d362b-343c-4472-a919-24f040a5a7d8 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: 6940d26f-8e1f-4189-b305-e0277d3659e2] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:52.223872 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a03d362b-343c-4472-a919-24f040a5a7d8 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:52.224333 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a03d362b-343c-4472-a919-24f040a5a7d8 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:52.225118 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a03d362b-343c-4472-a919-24f040a5a7d8 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:52.225559 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a03d362b-343c-4472-a919-24f040a5a7d8 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:52.257016 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a03d362b-343c-4472-a919-24f040a5a7d8 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:52.258254 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a03d362b-343c-4472-a919-24f040a5a7d8 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:52.258572 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.objects.instance [None req-a03d362b-343c-4472-a919-24f040a5a7d8 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lazy-loading 'fault' on Instance uuid 6940d26f-8e1f-4189-b305-e0277d3659e2 {{(pid=122901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:47:52.302815 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-a03d362b-343c-4472-a919-24f040a5a7d8 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:52.311729 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-a03d362b-343c-4472-a919-24f040a5a7d8 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2" status: 200 len: 1303 microversion: 2.1 time: 0.098044 Feb 08 16:47:52.311870 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 450/906] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:52 2022] GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:53.329680 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-43eab556-7a8b-4248-ae23-d9f0fadf6ef0 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:53.330369 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-43eab556-7a8b-4248-ae23-d9f0fadf6ef0 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: 6940d26f-8e1f-4189-b305-e0277d3659e2] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:53.337064 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-43eab556-7a8b-4248-ae23-d9f0fadf6ef0 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:53.337512 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-43eab556-7a8b-4248-ae23-d9f0fadf6ef0 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:53.338284 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-43eab556-7a8b-4248-ae23-d9f0fadf6ef0 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:53.338721 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-43eab556-7a8b-4248-ae23-d9f0fadf6ef0 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:53.351575 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-43eab556-7a8b-4248-ae23-d9f0fadf6ef0 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] HTTP exception thrown: Instance 6940d26f-8e1f-4189-b305-e0277d3659e2 could not be found. Feb 08 16:47:53.352309 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-43eab556-7a8b-4248-ae23-d9f0fadf6ef0 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Returning 404 to user: Instance 6940d26f-8e1f-4189-b305-e0277d3659e2 could not be found. {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:47:53.353661 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-43eab556-7a8b-4248-ae23-d9f0fadf6ef0 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2" status: 404 len: 111 microversion: 2.1 time: 0.028288 Feb 08 16:47:53.354179 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 457/907] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:53 2022] GET /compute/v2.1/servers/6940d26f-8e1f-4189-b305-e0277d3659e2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:47:53.447055 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-76aceab6-cd0d-4724-b71f-e566ac9ae179 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-791237234", "imageRef": "d70d3911-14f2-4cba-9283-bf4bef4fb526", "flavorRef": "452", "networks": [{"uuid": "6eff03a1-c6a7-4619-8332-f7ea53ea50ca"}]}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:47:53.497420 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.network.neutron [None req-76aceab6-cd0d-4724-b71f-e566ac9ae179 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] validate_networks() for [('6eff03a1-c6a7-4619-8332-f7ea53ea50ca', None, None, None, None, None)] {{(pid=122901) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 16:47:53.829373 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-76aceab6-cd0d-4724-b71f-e566ac9ae179 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Flavor limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 16:47:53.829830 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-76aceab6-cd0d-4724-b71f-e566ac9ae179 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Image limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 16:47:53.830351 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-76aceab6-cd0d-4724-b71f-e566ac9ae179 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Flavor pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 16:47:53.830754 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-76aceab6-cd0d-4724-b71f-e566ac9ae179 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Image pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 16:47:53.831190 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-76aceab6-cd0d-4724-b71f-e566ac9ae179 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 16:47:53.840152 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-76aceab6-cd0d-4724-b71f-e566ac9ae179 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:53.840597 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-76aceab6-cd0d-4724-b71f-e566ac9ae179 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:53.841396 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-76aceab6-cd0d-4724-b71f-e566ac9ae179 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:53.841823 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-76aceab6-cd0d-4724-b71f-e566ac9ae179 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:53.858209 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-76aceab6-cd0d-4724-b71f-e566ac9ae179 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Getting quotas for project 4628b38b90b6499e97fe1045b54098f8. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:47:53.861937 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-76aceab6-cd0d-4724-b71f-e566ac9ae179 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Getting quotas for user 2b96d3350af145ac8a7805eacfd8b246 and project 4628b38b90b6499e97fe1045b54098f8. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:47:53.872263 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-76aceab6-cd0d-4724-b71f-e566ac9ae179 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Going to run 1 instances... {{(pid=122901) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 16:47:53.874504 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-76aceab6-cd0d-4724-b71f-e566ac9ae179 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: d61440d1-fc9f-4f85-a422-76073d2ec105] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d70d3911-14f2-4cba-9283-bf4bef4fb526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122901) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 16:47:53.918454 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-76aceab6-cd0d-4724-b71f-e566ac9ae179 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.475566 Feb 08 16:47:53.919141 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 451/908] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Feb 8 16:47:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 16:47:53.929160 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-595e9bce-4ddd-4f39-b438-ae215b31e3b0 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:53.929789 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-595e9bce-4ddd-4f39-b438-ae215b31e3b0 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: d61440d1-fc9f-4f85-a422-76073d2ec105] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:53.982967 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-595e9bce-4ddd-4f39-b438-ae215b31e3b0 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:53.989616 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-595e9bce-4ddd-4f39-b438-ae215b31e3b0 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105" status: 200 len: 1213 microversion: 2.1 time: 0.064224 Feb 08 16:47:53.990216 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 458/909] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:53 2022] GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105 => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:55.006902 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-db5353ac-dd9a-499e-9be6-762d95fc9636 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:55.007525 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-db5353ac-dd9a-499e-9be6-762d95fc9636 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: d61440d1-fc9f-4f85-a422-76073d2ec105] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:55.013448 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-db5353ac-dd9a-499e-9be6-762d95fc9636 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:55.013897 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-db5353ac-dd9a-499e-9be6-762d95fc9636 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:55.014674 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-db5353ac-dd9a-499e-9be6-762d95fc9636 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:55.015109 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-db5353ac-dd9a-499e-9be6-762d95fc9636 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:55.084681 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-db5353ac-dd9a-499e-9be6-762d95fc9636 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:55.092868 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-db5353ac-dd9a-499e-9be6-762d95fc9636 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105" status: 200 len: 1271 microversion: 2.1 time: 0.090146 Feb 08 16:47:55.093442 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 452/910] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:55 2022] GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:56.102335 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-b0cd26df-792d-4ed5-af97-51bc9b660696 req-8d407449-0e86-43c5-a5c8-9b55735cc33c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d61440d1-fc9f-4f85-a422-76073d2ec105", "tag": "afd78fb5-4c91-4c9b-881d-0e5250f50aa7"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:47:56.105713 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:47:56.105713 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:47:56.110155 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-35f0b098-4148-4efa-b9ae-834caae30d59 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:56.110763 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-35f0b098-4148-4efa-b9ae-834caae30d59 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: d61440d1-fc9f-4f85-a422-76073d2ec105] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:56.114421 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-b0cd26df-792d-4ed5-af97-51bc9b660696 req-8d407449-0e86-43c5-a5c8-9b55735cc33c service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:56.114873 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-b0cd26df-792d-4ed5-af97-51bc9b660696 req-8d407449-0e86-43c5-a5c8-9b55735cc33c service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:56.123746 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-35f0b098-4148-4efa-b9ae-834caae30d59 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:56.124699 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-35f0b098-4148-4efa-b9ae-834caae30d59 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:56.125532 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-35f0b098-4148-4efa-b9ae-834caae30d59 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:56.125976 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-35f0b098-4148-4efa-b9ae-834caae30d59 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:56.129681 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-b0cd26df-792d-4ed5-af97-51bc9b660696 req-8d407449-0e86-43c5-a5c8-9b55735cc33c service nova] Creating event network-changed:afd78fb5-4c91-4c9b-881d-0e5250f50aa7 for instance d61440d1-fc9f-4f85-a422-76073d2ec105 on hv-cinder-82786 Feb 08 16:47:56.135524 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-b0cd26df-792d-4ed5-af97-51bc9b660696 req-8d407449-0e86-43c5-a5c8-9b55735cc33c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037620 Feb 08 16:47:56.136629 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 459/911] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:47:56.346375 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-35f0b098-4148-4efa-b9ae-834caae30d59 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:56.354161 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-35f0b098-4148-4efa-b9ae-834caae30d59 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105" status: 200 len: 1313 microversion: 2.1 time: 0.247630 Feb 08 16:47:56.354728 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 453/912] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:56 2022] GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:57.370974 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e62645be-7465-40be-b88f-c05613037fc5 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:57.371685 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e62645be-7465-40be-b88f-c05613037fc5 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: d61440d1-fc9f-4f85-a422-76073d2ec105] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:57.378929 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e62645be-7465-40be-b88f-c05613037fc5 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:57.379377 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e62645be-7465-40be-b88f-c05613037fc5 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:57.380205 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e62645be-7465-40be-b88f-c05613037fc5 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:57.380641 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e62645be-7465-40be-b88f-c05613037fc5 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:57.526246 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e62645be-7465-40be-b88f-c05613037fc5 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:57.533685 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e62645be-7465-40be-b88f-c05613037fc5 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105" status: 200 len: 1313 microversion: 2.1 time: 0.166798 Feb 08 16:47:57.534226 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 460/913] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:57 2022] GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:58.550455 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-bffaa33b-ae4b-458c-b7c7-3af4839f8694 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:58.551185 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-bffaa33b-ae4b-458c-b7c7-3af4839f8694 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: d61440d1-fc9f-4f85-a422-76073d2ec105] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:58.558499 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bffaa33b-ae4b-458c-b7c7-3af4839f8694 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:58.558946 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bffaa33b-ae4b-458c-b7c7-3af4839f8694 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:58.559743 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bffaa33b-ae4b-458c-b7c7-3af4839f8694 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:58.560204 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bffaa33b-ae4b-458c-b7c7-3af4839f8694 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:58.696970 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-bffaa33b-ae4b-458c-b7c7-3af4839f8694 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:58.704320 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-bffaa33b-ae4b-458c-b7c7-3af4839f8694 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105" status: 200 len: 1313 microversion: 2.1 time: 0.157606 Feb 08 16:47:58.704898 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 454/914] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:58 2022] GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:47:59.720907 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-9f8d09d4-9e3e-4a78-81bf-366609afeaee tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:47:59.721547 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-9f8d09d4-9e3e-4a78-81bf-366609afeaee tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: d61440d1-fc9f-4f85-a422-76073d2ec105] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:47:59.728049 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9f8d09d4-9e3e-4a78-81bf-366609afeaee tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:59.728508 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9f8d09d4-9e3e-4a78-81bf-366609afeaee tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:59.729294 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9f8d09d4-9e3e-4a78-81bf-366609afeaee tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:47:59.729742 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9f8d09d4-9e3e-4a78-81bf-366609afeaee tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:47:59.859905 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9f8d09d4-9e3e-4a78-81bf-366609afeaee tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:47:59.867703 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-9f8d09d4-9e3e-4a78-81bf-366609afeaee tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105" status: 200 len: 1313 microversion: 2.1 time: 0.150562 Feb 08 16:47:59.868288 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 461/915] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:47:59 2022] GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:00.641571 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-bb48f09e-84a6-4997-a613-1c35fba525f5 req-acb12969-1626-4723-9a85-e4abcbfb3b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d61440d1-fc9f-4f85-a422-76073d2ec105", "name": "network-vif-plugged", "status": "completed", "tag": "afd78fb5-4c91-4c9b-881d-0e5250f50aa7"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:48:00.643231 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:48:00.643231 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:48:00.651550 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-bb48f09e-84a6-4997-a613-1c35fba525f5 req-acb12969-1626-4723-9a85-e4abcbfb3b69 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:00.652084 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-bb48f09e-84a6-4997-a613-1c35fba525f5 req-acb12969-1626-4723-9a85-e4abcbfb3b69 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:00.664887 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-bb48f09e-84a6-4997-a613-1c35fba525f5 req-acb12969-1626-4723-9a85-e4abcbfb3b69 service nova] Creating event network-vif-plugged:afd78fb5-4c91-4c9b-881d-0e5250f50aa7 for instance d61440d1-fc9f-4f85-a422-76073d2ec105 on hv-cinder-82786 Feb 08 16:48:00.670241 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-bb48f09e-84a6-4997-a613-1c35fba525f5 req-acb12969-1626-4723-9a85-e4abcbfb3b69 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032234 Feb 08 16:48:00.671003 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 455/916] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:48:00.884655 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-1b5265b2-2a6d-4731-a907-64f607b3733a tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:00.885153 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-1b5265b2-2a6d-4731-a907-64f607b3733a tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: d61440d1-fc9f-4f85-a422-76073d2ec105] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:00.891411 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1b5265b2-2a6d-4731-a907-64f607b3733a tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:00.891920 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1b5265b2-2a6d-4731-a907-64f607b3733a tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:00.892714 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1b5265b2-2a6d-4731-a907-64f607b3733a tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:00.893159 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1b5265b2-2a6d-4731-a907-64f607b3733a tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:01.023816 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-1b5265b2-2a6d-4731-a907-64f607b3733a tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:01.030953 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-1b5265b2-2a6d-4731-a907-64f607b3733a tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105" status: 200 len: 1313 microversion: 2.1 time: 0.150395 Feb 08 16:48:01.031519 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 462/917] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:00 2022] GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:02.049241 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b3733a4a-68ae-4738-9ed3-14bb103b071c tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:02.049955 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-b3733a4a-68ae-4738-9ed3-14bb103b071c tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: d61440d1-fc9f-4f85-a422-76073d2ec105] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:02.056866 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b3733a4a-68ae-4738-9ed3-14bb103b071c tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:02.057312 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b3733a4a-68ae-4738-9ed3-14bb103b071c tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:02.058084 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b3733a4a-68ae-4738-9ed3-14bb103b071c tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:02.058514 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b3733a4a-68ae-4738-9ed3-14bb103b071c tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:02.187943 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-b3733a4a-68ae-4738-9ed3-14bb103b071c tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:02.195783 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-b3733a4a-68ae-4738-9ed3-14bb103b071c tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105" status: 200 len: 1313 microversion: 2.1 time: 0.151075 Feb 08 16:48:02.196354 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 456/918] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:02 2022] GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:03.212837 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-35b4115d-ef4b-4540-a96e-dda22dc8fa8f tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:03.213510 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-35b4115d-ef4b-4540-a96e-dda22dc8fa8f tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: d61440d1-fc9f-4f85-a422-76073d2ec105] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:03.219841 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-35b4115d-ef4b-4540-a96e-dda22dc8fa8f tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:03.220298 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-35b4115d-ef4b-4540-a96e-dda22dc8fa8f tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:03.221084 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-35b4115d-ef4b-4540-a96e-dda22dc8fa8f tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:03.221525 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-35b4115d-ef4b-4540-a96e-dda22dc8fa8f tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:03.360710 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-35b4115d-ef4b-4540-a96e-dda22dc8fa8f tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:03.368425 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-35b4115d-ef4b-4540-a96e-dda22dc8fa8f tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105" status: 200 len: 1497 microversion: 2.1 time: 0.159959 Feb 08 16:48:03.368984 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 463/919] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:03 2022] GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105 => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:03.798077 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-71cf10d1-26dc-45b2-8679-5d3ea5c88992 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:03.798587 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-71cf10d1-26dc-45b2-8679-5d3ea5c88992 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: d61440d1-fc9f-4f85-a422-76073d2ec105] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:03.805832 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-71cf10d1-26dc-45b2-8679-5d3ea5c88992 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:03.806284 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-71cf10d1-26dc-45b2-8679-5d3ea5c88992 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:03.807072 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-71cf10d1-26dc-45b2-8679-5d3ea5c88992 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:03.807513 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-71cf10d1-26dc-45b2-8679-5d3ea5c88992 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:03.831102 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-71cf10d1-26dc-45b2-8679-5d3ea5c88992 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: d61440d1-fc9f-4f85-a422-76073d2ec105] Going to try to terminate instance {{(pid=122901) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 16:48:03.901164 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-71cf10d1-26dc-45b2-8679-5d3ea5c88992 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "DELETE /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105" status: 204 len: 0 microversion: 2.1 time: 0.106411 Feb 08 16:48:03.901742 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 457/920] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Feb 8 16:48:03 2022] DELETE /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 16:48:03.910252 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-34a9bc56-5165-4613-97b8-24d9d699636a tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:03.910858 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-34a9bc56-5165-4613-97b8-24d9d699636a tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: d61440d1-fc9f-4f85-a422-76073d2ec105] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:03.917255 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-34a9bc56-5165-4613-97b8-24d9d699636a tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:03.917732 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-34a9bc56-5165-4613-97b8-24d9d699636a tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:03.918509 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-34a9bc56-5165-4613-97b8-24d9d699636a tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:03.918949 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-34a9bc56-5165-4613-97b8-24d9d699636a tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:04.049965 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-34a9bc56-5165-4613-97b8-24d9d699636a tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:04.058082 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-34a9bc56-5165-4613-97b8-24d9d699636a tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105" status: 200 len: 1503 microversion: 2.1 time: 0.151612 Feb 08 16:48:04.058649 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 464/921] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:03 2022] GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:48:05.075395 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-49a35e70-9e19-49ac-958d-7272f8ceb7fb tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:05.076116 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-49a35e70-9e19-49ac-958d-7272f8ceb7fb tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: d61440d1-fc9f-4f85-a422-76073d2ec105] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:05.082357 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-49a35e70-9e19-49ac-958d-7272f8ceb7fb tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:05.082801 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-49a35e70-9e19-49ac-958d-7272f8ceb7fb tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:05.083573 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-49a35e70-9e19-49ac-958d-7272f8ceb7fb tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:05.084037 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-49a35e70-9e19-49ac-958d-7272f8ceb7fb tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:05.216840 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-49a35e70-9e19-49ac-958d-7272f8ceb7fb tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:05.224050 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-49a35e70-9e19-49ac-958d-7272f8ceb7fb tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105" status: 200 len: 1503 microversion: 2.1 time: 0.152708 Feb 08 16:48:05.224628 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 458/922] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:05 2022] GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:05.433714 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-37e44f75-8ff3-4b73-a6ff-adc5b42a9e83 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:05.434283 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-37e44f75-8ff3-4b73-a6ff-adc5b42a9e83 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:05.441353 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-37e44f75-8ff3-4b73-a6ff-adc5b42a9e83 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:05.441815 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-37e44f75-8ff3-4b73-a6ff-adc5b42a9e83 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:05.442603 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-37e44f75-8ff3-4b73-a6ff-adc5b42a9e83 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:05.443045 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-37e44f75-8ff3-4b73-a6ff-adc5b42a9e83 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:05.521403 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.objects.instance [None req-37e44f75-8ff3-4b73-a6ff-adc5b42a9e83 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lazy-loading 'services' on Instance uuid 136b1df1-a111-4a7b-8a8d-5e095dadc764 {{(pid=122902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:48:05.591013 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-37e44f75-8ff3-4b73-a6ff-adc5b42a9e83 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "DELETE /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764/os-volume_attachments/7704a2a6-585a-4362-8c4d-671d62a1434a" status: 202 len: 0 microversion: 2.1 time: 0.262750 Feb 08 16:48:05.591626 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 465/923] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Feb 8 16:48:05 2022] DELETE /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764/os-volume_attachments/7704a2a6-585a-4362-8c4d-671d62a1434a => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:48:06.107389 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-344a1a3e-a7b3-4652-8d70-538902a6f7ec req-806802aa-2fc5-4cce-81ef-40c029aacb98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d61440d1-fc9f-4f85-a422-76073d2ec105", "name": "network-vif-deleted", "tag": "afd78fb5-4c91-4c9b-881d-0e5250f50aa7"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:48:06.108927 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:48:06.108927 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:48:06.119650 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-344a1a3e-a7b3-4652-8d70-538902a6f7ec req-806802aa-2fc5-4cce-81ef-40c029aacb98 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:06.120199 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-344a1a3e-a7b3-4652-8d70-538902a6f7ec req-806802aa-2fc5-4cce-81ef-40c029aacb98 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:06.132587 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-344a1a3e-a7b3-4652-8d70-538902a6f7ec req-806802aa-2fc5-4cce-81ef-40c029aacb98 service nova] Creating event network-vif-deleted:afd78fb5-4c91-4c9b-881d-0e5250f50aa7 for instance d61440d1-fc9f-4f85-a422-76073d2ec105 on hv-cinder-82786 Feb 08 16:48:06.137271 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-344a1a3e-a7b3-4652-8d70-538902a6f7ec req-806802aa-2fc5-4cce-81ef-40c029aacb98 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033447 Feb 08 16:48:06.137870 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 459/924] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:48:06.245042 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-f042a4d1-60fe-4f85-a0cb-00a567a0fb78 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:06.246175 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-f042a4d1-60fe-4f85-a0cb-00a567a0fb78 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: d61440d1-fc9f-4f85-a422-76073d2ec105] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:06.253733 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f042a4d1-60fe-4f85-a0cb-00a567a0fb78 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:06.254220 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f042a4d1-60fe-4f85-a0cb-00a567a0fb78 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:06.255015 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f042a4d1-60fe-4f85-a0cb-00a567a0fb78 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:06.255491 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f042a4d1-60fe-4f85-a0cb-00a567a0fb78 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:06.286462 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f042a4d1-60fe-4f85-a0cb-00a567a0fb78 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:06.286908 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f042a4d1-60fe-4f85-a0cb-00a567a0fb78 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:06.287406 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.objects.instance [None req-f042a4d1-60fe-4f85-a0cb-00a567a0fb78 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lazy-loading 'fault' on Instance uuid d61440d1-fc9f-4f85-a422-76073d2ec105 {{(pid=122902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:48:06.328851 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-f042a4d1-60fe-4f85-a0cb-00a567a0fb78 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96d3350af145ac8a7805eacfd8b246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4628b38b90b6499e97fe1045b54098f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:06.336661 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-f042a4d1-60fe-4f85-a0cb-00a567a0fb78 tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105" status: 200 len: 1303 microversion: 2.1 time: 0.097255 Feb 08 16:48:06.337304 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 466/925] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:06 2022] GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:06.703038 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ea3d21d1-8344-4c45-9bb4-0e2c09d6f20e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:48:06.709164 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ea3d21d1-8344-4c45-9bb4-0e2c09d6f20e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:06.709619 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ea3d21d1-8344-4c45-9bb4-0e2c09d6f20e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:06.731708 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-ea3d21d1-8344-4c45-9bb4-0e2c09d6f20e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Going to try to stop instance {{(pid=122901) force_stop /opt/stack/nova/nova/compute/api.py:2655}} Feb 08 16:48:06.773436 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-ea3d21d1-8344-4c45-9bb4-0e2c09d6f20e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "POST /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764/action" status: 202 len: 0 microversion: 2.1 time: 0.073990 Feb 08 16:48:06.774073 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 460/926] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Feb 8 16:48:06 2022] POST /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:48:06.782144 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c77d7d3c-d91b-43ba-8586-da441eeda9c9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:06.782769 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c77d7d3c-d91b-43ba-8586-da441eeda9c9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:06.789371 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c77d7d3c-d91b-43ba-8586-da441eeda9c9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:06.790010 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c77d7d3c-d91b-43ba-8586-da441eeda9c9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:06.790961 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c77d7d3c-d91b-43ba-8586-da441eeda9c9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:06.791519 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c77d7d3c-d91b-43ba-8586-da441eeda9c9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:06.929370 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c77d7d3c-d91b-43ba-8586-da441eeda9c9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:06.936727 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c77d7d3c-d91b-43ba-8586-da441eeda9c9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1678 microversion: 2.1 time: 0.158207 Feb 08 16:48:06.937292 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 467/927] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:06 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:48:07.353804 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-19742360-af2c-4b84-8617-e0b3faa85bff tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:07.354503 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-19742360-af2c-4b84-8617-e0b3faa85bff tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] [instance: d61440d1-fc9f-4f85-a422-76073d2ec105] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:07.361031 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-19742360-af2c-4b84-8617-e0b3faa85bff tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:07.361484 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-19742360-af2c-4b84-8617-e0b3faa85bff tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:07.362265 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-19742360-af2c-4b84-8617-e0b3faa85bff tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:07.362705 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-19742360-af2c-4b84-8617-e0b3faa85bff tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:07.378225 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.wsgi [None req-19742360-af2c-4b84-8617-e0b3faa85bff tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] HTTP exception thrown: Instance d61440d1-fc9f-4f85-a422-76073d2ec105 could not be found. Feb 08 16:48:07.378815 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-19742360-af2c-4b84-8617-e0b3faa85bff tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] Returning 404 to user: Instance d61440d1-fc9f-4f85-a422-76073d2ec105 could not be found. {{(pid=122901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:48:07.379627 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-19742360-af2c-4b84-8617-e0b3faa85bff tempest-VolumesActionsTest-1359919991 tempest-VolumesActionsTest-1359919991-project] 10.222.0.35 "GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105" status: 404 len: 111 microversion: 2.1 time: 0.029886 Feb 08 16:48:07.380204 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 461/928] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:07 2022] GET /compute/v2.1/servers/d61440d1-fc9f-4f85-a422-76073d2ec105 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:48:07.954193 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-3af1dd8c-1eda-490f-86c4-49ff3ae81c16 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:07.954815 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-3af1dd8c-1eda-490f-86c4-49ff3ae81c16 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:07.961976 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3af1dd8c-1eda-490f-86c4-49ff3ae81c16 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:07.962420 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3af1dd8c-1eda-490f-86c4-49ff3ae81c16 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:07.963209 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3af1dd8c-1eda-490f-86c4-49ff3ae81c16 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:07.963650 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3af1dd8c-1eda-490f-86c4-49ff3ae81c16 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:08.098363 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3af1dd8c-1eda-490f-86c4-49ff3ae81c16 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:08.106691 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-3af1dd8c-1eda-490f-86c4-49ff3ae81c16 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1678 microversion: 2.1 time: 0.156212 Feb 08 16:48:08.107264 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 468/929] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:07 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:09.123915 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-bec0ede4-051f-4f14-8666-7467376b1875 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:09.124534 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-bec0ede4-051f-4f14-8666-7467376b1875 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:09.131079 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bec0ede4-051f-4f14-8666-7467376b1875 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:09.131527 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bec0ede4-051f-4f14-8666-7467376b1875 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:09.132333 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bec0ede4-051f-4f14-8666-7467376b1875 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:09.132898 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bec0ede4-051f-4f14-8666-7467376b1875 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:09.265843 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-bec0ede4-051f-4f14-8666-7467376b1875 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:09.273126 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-bec0ede4-051f-4f14-8666-7467376b1875 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1678 microversion: 2.1 time: 0.152852 Feb 08 16:48:09.274332 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 462/930] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:09 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:10.290323 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-da8e3177-ac71-4e4a-b198-95ee599132fd tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:10.290841 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-da8e3177-ac71-4e4a-b198-95ee599132fd tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:10.297241 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-da8e3177-ac71-4e4a-b198-95ee599132fd tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:10.297702 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-da8e3177-ac71-4e4a-b198-95ee599132fd tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:10.298489 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-da8e3177-ac71-4e4a-b198-95ee599132fd tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:10.298938 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-da8e3177-ac71-4e4a-b198-95ee599132fd tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:10.436495 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-da8e3177-ac71-4e4a-b198-95ee599132fd tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:10.443879 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-da8e3177-ac71-4e4a-b198-95ee599132fd tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1678 microversion: 2.1 time: 0.157372 Feb 08 16:48:10.444449 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 469/931] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:10 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:11.460658 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-9d2c220e-ad10-4e6b-b906-6f184020c0f0 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:11.461919 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-9d2c220e-ad10-4e6b-b906-6f184020c0f0 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:11.468289 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9d2c220e-ad10-4e6b-b906-6f184020c0f0 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:11.468738 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9d2c220e-ad10-4e6b-b906-6f184020c0f0 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:11.469519 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9d2c220e-ad10-4e6b-b906-6f184020c0f0 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:11.469963 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9d2c220e-ad10-4e6b-b906-6f184020c0f0 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:11.597540 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-9d2c220e-ad10-4e6b-b906-6f184020c0f0 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:11.605239 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-9d2c220e-ad10-4e6b-b906-6f184020c0f0 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1678 microversion: 2.1 time: 0.148306 Feb 08 16:48:11.605806 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 463/932] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:11 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:12.622152 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-ae407be8-2112-4649-b1ad-618d736a56ac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:12.622679 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-ae407be8-2112-4649-b1ad-618d736a56ac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:12.629203 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ae407be8-2112-4649-b1ad-618d736a56ac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:12.629655 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ae407be8-2112-4649-b1ad-618d736a56ac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:12.630435 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ae407be8-2112-4649-b1ad-618d736a56ac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:12.630876 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ae407be8-2112-4649-b1ad-618d736a56ac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:12.762521 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ae407be8-2112-4649-b1ad-618d736a56ac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:12.769855 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-ae407be8-2112-4649-b1ad-618d736a56ac tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1678 microversion: 2.1 time: 0.151503 Feb 08 16:48:12.770422 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 470/933] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:12 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:13.787347 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e832a82a-585f-4ec8-ba1a-256b481bbaae tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:13.788201 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e832a82a-585f-4ec8-ba1a-256b481bbaae tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:13.795386 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e832a82a-585f-4ec8-ba1a-256b481bbaae tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:13.796119 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e832a82a-585f-4ec8-ba1a-256b481bbaae tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:13.797133 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e832a82a-585f-4ec8-ba1a-256b481bbaae tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:13.797577 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e832a82a-585f-4ec8-ba1a-256b481bbaae tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:13.955386 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e832a82a-585f-4ec8-ba1a-256b481bbaae tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:13.963200 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e832a82a-585f-4ec8-ba1a-256b481bbaae tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1678 microversion: 2.1 time: 0.180079 Feb 08 16:48:13.964095 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 464/934] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:13 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:14.982364 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-cda0e811-b57a-4b46-83c9-4fa02f1da52e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:14.983343 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-cda0e811-b57a-4b46-83c9-4fa02f1da52e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:14.991982 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cda0e811-b57a-4b46-83c9-4fa02f1da52e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:14.992811 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cda0e811-b57a-4b46-83c9-4fa02f1da52e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:14.994418 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cda0e811-b57a-4b46-83c9-4fa02f1da52e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:14.995088 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cda0e811-b57a-4b46-83c9-4fa02f1da52e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:15.168973 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-cda0e811-b57a-4b46-83c9-4fa02f1da52e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:15.177104 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-cda0e811-b57a-4b46-83c9-4fa02f1da52e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1678 microversion: 2.1 time: 0.199562 Feb 08 16:48:15.177674 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 471/935] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:14 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1678 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:16.196926 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-449b1d35-1c18-4ba8-9fd6-1ec00cf6da08 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:16.198240 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-449b1d35-1c18-4ba8-9fd6-1ec00cf6da08 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:16.205044 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-449b1d35-1c18-4ba8-9fd6-1ec00cf6da08 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:16.205762 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-449b1d35-1c18-4ba8-9fd6-1ec00cf6da08 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:16.206795 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-449b1d35-1c18-4ba8-9fd6-1ec00cf6da08 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:16.207444 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-449b1d35-1c18-4ba8-9fd6-1ec00cf6da08 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:16.392696 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-449b1d35-1c18-4ba8-9fd6-1ec00cf6da08 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:16.401879 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-449b1d35-1c18-4ba8-9fd6-1ec00cf6da08 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1678 microversion: 2.1 time: 0.208675 Feb 08 16:48:16.402629 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 465/936] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:16 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1678 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:17.419143 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-0bb6b569-a2e7-4dcc-85fa-be5e6ae59e57 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:17.420779 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-0bb6b569-a2e7-4dcc-85fa-be5e6ae59e57 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:17.427115 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0bb6b569-a2e7-4dcc-85fa-be5e6ae59e57 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:17.427640 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0bb6b569-a2e7-4dcc-85fa-be5e6ae59e57 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:17.428710 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0bb6b569-a2e7-4dcc-85fa-be5e6ae59e57 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:17.429402 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0bb6b569-a2e7-4dcc-85fa-be5e6ae59e57 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:17.585128 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-0bb6b569-a2e7-4dcc-85fa-be5e6ae59e57 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:17.596038 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-0bb6b569-a2e7-4dcc-85fa-be5e6ae59e57 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1678 microversion: 2.1 time: 0.180125 Feb 08 16:48:17.596789 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 472/937] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:17 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:18.616503 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-9200f9d3-7100-44c3-ae81-14a9bfeacbc5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:18.617165 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-9200f9d3-7100-44c3-ae81-14a9bfeacbc5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:18.627877 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9200f9d3-7100-44c3-ae81-14a9bfeacbc5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:18.629105 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9200f9d3-7100-44c3-ae81-14a9bfeacbc5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:18.630544 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9200f9d3-7100-44c3-ae81-14a9bfeacbc5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:18.631431 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9200f9d3-7100-44c3-ae81-14a9bfeacbc5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:18.787740 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-9200f9d3-7100-44c3-ae81-14a9bfeacbc5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:18.796401 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-9200f9d3-7100-44c3-ae81-14a9bfeacbc5 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1678 microversion: 2.1 time: 0.183510 Feb 08 16:48:18.797575 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 466/938] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:18 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:19.816557 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-9f726c04-4eb2-4514-b7ea-7d5637f0d1fa tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:19.817948 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-9f726c04-4eb2-4514-b7ea-7d5637f0d1fa tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:19.825093 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9f726c04-4eb2-4514-b7ea-7d5637f0d1fa tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:19.826094 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9f726c04-4eb2-4514-b7ea-7d5637f0d1fa tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:19.827139 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9f726c04-4eb2-4514-b7ea-7d5637f0d1fa tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:19.827878 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9f726c04-4eb2-4514-b7ea-7d5637f0d1fa tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:19.975555 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9f726c04-4eb2-4514-b7ea-7d5637f0d1fa tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:19.986272 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-9f726c04-4eb2-4514-b7ea-7d5637f0d1fa tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1678 microversion: 2.1 time: 0.173167 Feb 08 16:48:19.987174 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 473/939] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:19 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:21.004243 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-1eac02e4-f14d-4b4b-a4b2-71f8ddac032e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:21.004848 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-1eac02e4-f14d-4b4b-a4b2-71f8ddac032e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:21.011801 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1eac02e4-f14d-4b4b-a4b2-71f8ddac032e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:21.012247 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1eac02e4-f14d-4b4b-a4b2-71f8ddac032e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:21.013229 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1eac02e4-f14d-4b4b-a4b2-71f8ddac032e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:21.013940 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1eac02e4-f14d-4b4b-a4b2-71f8ddac032e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:21.187736 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-1eac02e4-f14d-4b4b-a4b2-71f8ddac032e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:21.198453 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-1eac02e4-f14d-4b4b-a4b2-71f8ddac032e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1678 microversion: 2.1 time: 0.197826 Feb 08 16:48:21.199091 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 467/940] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:20 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1678 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:22.218319 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-81703b8b-3022-4a22-b32e-f982dc8933ff tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:22.218924 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-81703b8b-3022-4a22-b32e-f982dc8933ff tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:22.226037 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-81703b8b-3022-4a22-b32e-f982dc8933ff tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:22.226523 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-81703b8b-3022-4a22-b32e-f982dc8933ff tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:22.227322 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-81703b8b-3022-4a22-b32e-f982dc8933ff tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:22.227788 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-81703b8b-3022-4a22-b32e-f982dc8933ff tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:22.425308 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-81703b8b-3022-4a22-b32e-f982dc8933ff tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:22.434678 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-81703b8b-3022-4a22-b32e-f982dc8933ff tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1655 microversion: 2.1 time: 0.219394 Feb 08 16:48:22.434678 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 474/941] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:22 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1655 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:22.452865 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-7a437e05-51f4-428b-8fb5-6127541e7ee8 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:48:22.464634 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7a437e05-51f4-428b-8fb5-6127541e7ee8 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:22.465601 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7a437e05-51f4-428b-8fb5-6127541e7ee8 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:22.493579 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7a437e05-51f4-428b-8fb5-6127541e7ee8 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Going to try to start instance {{(pid=122901) start /opt/stack/nova/nova/compute/api.py:2678}} Feb 08 16:48:22.543028 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-7a437e05-51f4-428b-8fb5-6127541e7ee8 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "POST /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764/action" status: 202 len: 0 microversion: 2.1 time: 0.095330 Feb 08 16:48:22.544028 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 468/942] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Feb 8 16:48:22 2022] POST /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:48:22.552590 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-44a34b4f-971f-4f8f-a600-1c888ba22878 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:22.553653 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-44a34b4f-971f-4f8f-a600-1c888ba22878 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:22.568105 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-44a34b4f-971f-4f8f-a600-1c888ba22878 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:22.568989 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-44a34b4f-971f-4f8f-a600-1c888ba22878 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:22.571672 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-44a34b4f-971f-4f8f-a600-1c888ba22878 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:22.572185 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-44a34b4f-971f-4f8f-a600-1c888ba22878 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:22.767495 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-44a34b4f-971f-4f8f-a600-1c888ba22878 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:22.779129 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-44a34b4f-971f-4f8f-a600-1c888ba22878 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1664 microversion: 2.1 time: 0.227982 Feb 08 16:48:22.779772 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 475/943] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:22 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1664 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:23.806594 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-8d1f0c0c-7484-4d5d-b2af-86ac666f2419 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:23.808313 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-8d1f0c0c-7484-4d5d-b2af-86ac666f2419 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:23.815326 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8d1f0c0c-7484-4d5d-b2af-86ac666f2419 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:23.816147 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8d1f0c0c-7484-4d5d-b2af-86ac666f2419 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:23.817335 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8d1f0c0c-7484-4d5d-b2af-86ac666f2419 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:23.818587 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8d1f0c0c-7484-4d5d-b2af-86ac666f2419 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:24.032865 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-8d1f0c0c-7484-4d5d-b2af-86ac666f2419 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:24.041602 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-8d1f0c0c-7484-4d5d-b2af-86ac666f2419 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1668 microversion: 2.1 time: 0.241464 Feb 08 16:48:24.042456 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 469/944] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:23 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1668 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:39.308835 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-67b74987-4421-4998-8ed0-f0e026787838 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:48:39.309383 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-67b74987-4421-4998-8ed0-f0e026787838 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:39.315452 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-67b74987-4421-4998-8ed0-f0e026787838 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:39.315948 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-67b74987-4421-4998-8ed0-f0e026787838 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:39.316736 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-67b74987-4421-4998-8ed0-f0e026787838 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:39.317224 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-67b74987-4421-4998-8ed0-f0e026787838 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:39.339121 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.objects.instance [None req-67b74987-4421-4998-8ed0-f0e026787838 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lazy-loading 'flavor' on Instance uuid 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 {{(pid=122902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:48:39.414673 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-67b74987-4421-4998-8ed0-f0e026787838 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "POST /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287/action" status: 202 len: 0 microversion: 2.1 time: 0.109536 Feb 08 16:48:39.415277 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 476/945] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Feb 8 16:48:39 2022] POST /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:48:39.427959 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e4d64997-10ea-4c55-b196-fc05db89e200 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:39.428734 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e4d64997-10ea-4c55-b196-fc05db89e200 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:39.436481 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e4d64997-10ea-4c55-b196-fc05db89e200 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:39.436921 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e4d64997-10ea-4c55-b196-fc05db89e200 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:39.437716 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e4d64997-10ea-4c55-b196-fc05db89e200 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:39.438154 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e4d64997-10ea-4c55-b196-fc05db89e200 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:39.579423 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e4d64997-10ea-4c55-b196-fc05db89e200 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:39.586766 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e4d64997-10ea-4c55-b196-fc05db89e200 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.166398 Feb 08 16:48:39.587328 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 470/946] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:39 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:40.606002 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-77d47335-2cc0-475f-921e-aa0ed5b2b80c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:40.606777 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-77d47335-2cc0-475f-921e-aa0ed5b2b80c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:40.613002 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-77d47335-2cc0-475f-921e-aa0ed5b2b80c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:40.613460 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-77d47335-2cc0-475f-921e-aa0ed5b2b80c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:40.614250 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-77d47335-2cc0-475f-921e-aa0ed5b2b80c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:40.614690 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-77d47335-2cc0-475f-921e-aa0ed5b2b80c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:40.759409 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-77d47335-2cc0-475f-921e-aa0ed5b2b80c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:40.767263 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-77d47335-2cc0-475f-921e-aa0ed5b2b80c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.166173 Feb 08 16:48:40.768090 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 477/947] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:40 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:41.785207 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-f4d9a4c5-7e37-4873-946f-62c992663f8d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:41.785752 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-f4d9a4c5-7e37-4873-946f-62c992663f8d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:41.792128 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f4d9a4c5-7e37-4873-946f-62c992663f8d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:41.792579 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f4d9a4c5-7e37-4873-946f-62c992663f8d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:41.793351 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f4d9a4c5-7e37-4873-946f-62c992663f8d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:41.793836 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f4d9a4c5-7e37-4873-946f-62c992663f8d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:41.928804 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f4d9a4c5-7e37-4873-946f-62c992663f8d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:41.936225 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-f4d9a4c5-7e37-4873-946f-62c992663f8d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.154721 Feb 08 16:48:41.936781 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 471/948] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:41 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:42.953132 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-61ddf269-3877-4dd4-9ea6-4f4eeaa9642f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:42.953748 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-61ddf269-3877-4dd4-9ea6-4f4eeaa9642f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:42.960034 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-61ddf269-3877-4dd4-9ea6-4f4eeaa9642f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:42.960494 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-61ddf269-3877-4dd4-9ea6-4f4eeaa9642f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:42.961274 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-61ddf269-3877-4dd4-9ea6-4f4eeaa9642f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:42.961715 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-61ddf269-3877-4dd4-9ea6-4f4eeaa9642f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:43.094904 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-61ddf269-3877-4dd4-9ea6-4f4eeaa9642f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:43.102161 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-61ddf269-3877-4dd4-9ea6-4f4eeaa9642f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.152977 Feb 08 16:48:43.102718 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 478/949] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:42 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:44.119573 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-926283a8-5db2-480f-be56-5cc6346fb31c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:44.120216 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-926283a8-5db2-480f-be56-5cc6346fb31c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:44.127890 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-926283a8-5db2-480f-be56-5cc6346fb31c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:44.128346 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-926283a8-5db2-480f-be56-5cc6346fb31c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:44.129127 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-926283a8-5db2-480f-be56-5cc6346fb31c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:44.129565 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-926283a8-5db2-480f-be56-5cc6346fb31c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:44.260077 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-926283a8-5db2-480f-be56-5cc6346fb31c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:44.267709 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-926283a8-5db2-480f-be56-5cc6346fb31c tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.152005 Feb 08 16:48:44.268313 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 472/950] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:44 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:45.284271 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-d4d02a82-ce29-4270-ae82-6f334254551a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:45.284895 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-d4d02a82-ce29-4270-ae82-6f334254551a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:45.291162 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d4d02a82-ce29-4270-ae82-6f334254551a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:45.291619 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d4d02a82-ce29-4270-ae82-6f334254551a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:45.292448 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d4d02a82-ce29-4270-ae82-6f334254551a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:45.292894 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d4d02a82-ce29-4270-ae82-6f334254551a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:45.428178 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-d4d02a82-ce29-4270-ae82-6f334254551a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:45.436754 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-d4d02a82-ce29-4270-ae82-6f334254551a tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.156100 Feb 08 16:48:45.437831 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 479/951] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:45 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:46.454685 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-63776d7c-1583-40f0-9b55-b48d7ce08abe tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:46.455365 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-63776d7c-1583-40f0-9b55-b48d7ce08abe tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:46.462114 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-63776d7c-1583-40f0-9b55-b48d7ce08abe tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:46.462565 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-63776d7c-1583-40f0-9b55-b48d7ce08abe tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:46.463363 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-63776d7c-1583-40f0-9b55-b48d7ce08abe tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:46.463828 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-63776d7c-1583-40f0-9b55-b48d7ce08abe tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:46.601219 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-63776d7c-1583-40f0-9b55-b48d7ce08abe tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:46.608623 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-63776d7c-1583-40f0-9b55-b48d7ce08abe tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.158017 Feb 08 16:48:46.609220 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 473/952] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:46 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:47.625360 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-d681f5a9-38f8-46e4-95a3-fd0d1eee9a1f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:47.626196 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-d681f5a9-38f8-46e4-95a3-fd0d1eee9a1f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:47.632500 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d681f5a9-38f8-46e4-95a3-fd0d1eee9a1f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:47.632953 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d681f5a9-38f8-46e4-95a3-fd0d1eee9a1f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:47.633763 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d681f5a9-38f8-46e4-95a3-fd0d1eee9a1f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:47.634203 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d681f5a9-38f8-46e4-95a3-fd0d1eee9a1f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:47.773448 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-d681f5a9-38f8-46e4-95a3-fd0d1eee9a1f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:47.780880 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-d681f5a9-38f8-46e4-95a3-fd0d1eee9a1f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.159818 Feb 08 16:48:47.781448 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 480/953] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:47 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:48.797836 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-2704a7cf-0d01-483f-a74c-2b010efd0471 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:48.798356 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-2704a7cf-0d01-483f-a74c-2b010efd0471 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:48.804598 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2704a7cf-0d01-483f-a74c-2b010efd0471 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:48.805046 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2704a7cf-0d01-483f-a74c-2b010efd0471 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:48.805818 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2704a7cf-0d01-483f-a74c-2b010efd0471 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:48.806251 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2704a7cf-0d01-483f-a74c-2b010efd0471 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:48.945144 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-2704a7cf-0d01-483f-a74c-2b010efd0471 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:48.953311 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-2704a7cf-0d01-483f-a74c-2b010efd0471 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.159253 Feb 08 16:48:48.953885 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 474/954] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:48 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:48.957779 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-972081a3-c522-4f9d-a919-4ef4b5121c18 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:48:48.958833 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-972081a3-c522-4f9d-a919-4ef4b5121c18 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:48.965010 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-972081a3-c522-4f9d-a919-4ef4b5121c18 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:48.965720 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-972081a3-c522-4f9d-a919-4ef4b5121c18 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:48.966641 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-972081a3-c522-4f9d-a919-4ef4b5121c18 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:48.967085 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-972081a3-c522-4f9d-a919-4ef4b5121c18 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:49.037390 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-972081a3-c522-4f9d-a919-4ef4b5121c18 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "POST /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3/action" status: 202 len: 0 microversion: 2.1 time: 0.083123 Feb 08 16:48:49.039542 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 481/955] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Feb 8 16:48:48 2022] POST /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 08 16:48:49.046117 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-0c12bdb6-1a7e-403f-b799-e9e2aa533d42 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:49.046730 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-0c12bdb6-1a7e-403f-b799-e9e2aa533d42 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:49.052791 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0c12bdb6-1a7e-403f-b799-e9e2aa533d42 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:49.053160 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0c12bdb6-1a7e-403f-b799-e9e2aa533d42 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:49.053995 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0c12bdb6-1a7e-403f-b799-e9e2aa533d42 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:49.054447 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0c12bdb6-1a7e-403f-b799-e9e2aa533d42 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:49.289864 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0c12bdb6-1a7e-403f-b799-e9e2aa533d42 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:49.298062 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-0c12bdb6-1a7e-403f-b799-e9e2aa533d42 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1753 microversion: 2.1 time: 0.255681 Feb 08 16:48:49.298635 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 475/956] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:49 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1753 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:49.971499 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-5a3339c6-8931-4f08-a625-c73caa3969cc tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:49.972228 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-5a3339c6-8931-4f08-a625-c73caa3969cc tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:49.978299 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5a3339c6-8931-4f08-a625-c73caa3969cc tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:49.978748 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5a3339c6-8931-4f08-a625-c73caa3969cc tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:49.979533 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5a3339c6-8931-4f08-a625-c73caa3969cc tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:49.980009 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5a3339c6-8931-4f08-a625-c73caa3969cc tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:50.115962 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-5a3339c6-8931-4f08-a625-c73caa3969cc tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:50.123871 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-5a3339c6-8931-4f08-a625-c73caa3969cc tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.156825 Feb 08 16:48:50.124434 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 482/957] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:49 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:50.314727 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-05ae00b8-18a8-42b2-86b8-56e2cac58f5f tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:50.315338 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-05ae00b8-18a8-42b2-86b8-56e2cac58f5f tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:50.321823 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-05ae00b8-18a8-42b2-86b8-56e2cac58f5f tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:50.322272 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-05ae00b8-18a8-42b2-86b8-56e2cac58f5f tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:50.323054 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-05ae00b8-18a8-42b2-86b8-56e2cac58f5f tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:50.323488 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-05ae00b8-18a8-42b2-86b8-56e2cac58f5f tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:50.467736 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-05ae00b8-18a8-42b2-86b8-56e2cac58f5f tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:50.475676 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-05ae00b8-18a8-42b2-86b8-56e2cac58f5f tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1758 microversion: 2.1 time: 0.164402 Feb 08 16:48:50.476282 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 476/958] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:50 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:51.140301 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-7be96086-a9e2-4904-8c6d-29cef361a4f4 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:51.140920 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-7be96086-a9e2-4904-8c6d-29cef361a4f4 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:51.147288 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7be96086-a9e2-4904-8c6d-29cef361a4f4 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:51.147746 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7be96086-a9e2-4904-8c6d-29cef361a4f4 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:51.148557 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7be96086-a9e2-4904-8c6d-29cef361a4f4 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:51.148999 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7be96086-a9e2-4904-8c6d-29cef361a4f4 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:51.286231 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-7be96086-a9e2-4904-8c6d-29cef361a4f4 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:51.294744 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-7be96086-a9e2-4904-8c6d-29cef361a4f4 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.158174 Feb 08 16:48:51.295371 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 483/959] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:51 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:51.492881 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-7aff55c0-2600-4943-a0b4-ca2207924583 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:51.493455 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7aff55c0-2600-4943-a0b4-ca2207924583 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:51.500318 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7aff55c0-2600-4943-a0b4-ca2207924583 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:51.501023 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7aff55c0-2600-4943-a0b4-ca2207924583 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:51.501801 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7aff55c0-2600-4943-a0b4-ca2207924583 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:51.502242 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7aff55c0-2600-4943-a0b4-ca2207924583 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:51.647907 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7aff55c0-2600-4943-a0b4-ca2207924583 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:51.655851 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-7aff55c0-2600-4943-a0b4-ca2207924583 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1758 microversion: 2.1 time: 0.166674 Feb 08 16:48:51.656476 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 477/960] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:51 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:52.311889 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-8d89bef7-2c7a-4176-8ee5-55dc644c9292 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:52.312513 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-8d89bef7-2c7a-4176-8ee5-55dc644c9292 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:52.318886 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8d89bef7-2c7a-4176-8ee5-55dc644c9292 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:52.319346 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8d89bef7-2c7a-4176-8ee5-55dc644c9292 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:52.320172 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8d89bef7-2c7a-4176-8ee5-55dc644c9292 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:52.320616 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8d89bef7-2c7a-4176-8ee5-55dc644c9292 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:52.455971 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-8d89bef7-2c7a-4176-8ee5-55dc644c9292 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:52.463335 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-8d89bef7-2c7a-4176-8ee5-55dc644c9292 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.155274 Feb 08 16:48:52.463941 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 484/961] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:52 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:52.673128 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-f6f9e215-86a2-4066-b6d2-7c0deef2974c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:52.673797 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-f6f9e215-86a2-4066-b6d2-7c0deef2974c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:52.679989 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f6f9e215-86a2-4066-b6d2-7c0deef2974c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:52.680443 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f6f9e215-86a2-4066-b6d2-7c0deef2974c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:52.681223 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f6f9e215-86a2-4066-b6d2-7c0deef2974c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:52.681684 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f6f9e215-86a2-4066-b6d2-7c0deef2974c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:52.832380 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f6f9e215-86a2-4066-b6d2-7c0deef2974c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:52.841508 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-f6f9e215-86a2-4066-b6d2-7c0deef2974c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1758 microversion: 2.1 time: 0.172268 Feb 08 16:48:52.842355 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 478/962] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:52 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:48:53.483019 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-f5954b89-7411-4124-8989-c9e08d5c0e4e tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:53.483632 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-f5954b89-7411-4124-8989-c9e08d5c0e4e tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:53.490584 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f5954b89-7411-4124-8989-c9e08d5c0e4e tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:53.491148 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f5954b89-7411-4124-8989-c9e08d5c0e4e tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:53.492160 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f5954b89-7411-4124-8989-c9e08d5c0e4e tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:53.492701 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f5954b89-7411-4124-8989-c9e08d5c0e4e tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:53.638184 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-f5954b89-7411-4124-8989-c9e08d5c0e4e tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:53.645478 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-f5954b89-7411-4124-8989-c9e08d5c0e4e tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.167053 Feb 08 16:48:53.646049 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 485/963] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:53 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:53.858406 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-33338576-7ba6-4594-b4ae-8f4def533184 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:53.858973 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-33338576-7ba6-4594-b4ae-8f4def533184 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:53.865246 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-33338576-7ba6-4594-b4ae-8f4def533184 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:53.865700 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-33338576-7ba6-4594-b4ae-8f4def533184 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:53.866477 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-33338576-7ba6-4594-b4ae-8f4def533184 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:53.866913 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-33338576-7ba6-4594-b4ae-8f4def533184 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:54.009592 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-33338576-7ba6-4594-b4ae-8f4def533184 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:54.017986 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-33338576-7ba6-4594-b4ae-8f4def533184 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1758 microversion: 2.1 time: 0.163546 Feb 08 16:48:54.018558 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 479/964] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:53 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:54.662237 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-aa5efc75-ec40-4a0a-8fc2-a7e0ebaa0456 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:54.662886 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-aa5efc75-ec40-4a0a-8fc2-a7e0ebaa0456 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:54.670201 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-aa5efc75-ec40-4a0a-8fc2-a7e0ebaa0456 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:54.670662 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-aa5efc75-ec40-4a0a-8fc2-a7e0ebaa0456 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:54.671525 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-aa5efc75-ec40-4a0a-8fc2-a7e0ebaa0456 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:54.672067 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-aa5efc75-ec40-4a0a-8fc2-a7e0ebaa0456 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:54.812329 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-aa5efc75-ec40-4a0a-8fc2-a7e0ebaa0456 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:54.819734 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-aa5efc75-ec40-4a0a-8fc2-a7e0ebaa0456 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.161150 Feb 08 16:48:54.820330 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 486/965] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:54 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:55.035452 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d55ecf11-f27b-42af-8ed8-3d028947558a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:55.036195 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-d55ecf11-f27b-42af-8ed8-3d028947558a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:55.042552 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d55ecf11-f27b-42af-8ed8-3d028947558a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:55.043049 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d55ecf11-f27b-42af-8ed8-3d028947558a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:55.043973 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d55ecf11-f27b-42af-8ed8-3d028947558a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:55.044420 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d55ecf11-f27b-42af-8ed8-3d028947558a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:55.271685 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d55ecf11-f27b-42af-8ed8-3d028947558a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:55.279792 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d55ecf11-f27b-42af-8ed8-3d028947558a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1758 microversion: 2.1 time: 0.248010 Feb 08 16:48:55.280373 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 480/966] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:55 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1758 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:55.836595 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-52caf2e5-89fd-4683-ad03-3703500d770d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:55.837211 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-52caf2e5-89fd-4683-ad03-3703500d770d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:55.843672 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-52caf2e5-89fd-4683-ad03-3703500d770d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:55.844173 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-52caf2e5-89fd-4683-ad03-3703500d770d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:55.844953 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-52caf2e5-89fd-4683-ad03-3703500d770d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:55.845393 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-52caf2e5-89fd-4683-ad03-3703500d770d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:55.979968 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-52caf2e5-89fd-4683-ad03-3703500d770d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:55.987733 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-52caf2e5-89fd-4683-ad03-3703500d770d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.154900 Feb 08 16:48:55.988332 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 487/967] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:55 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:56.297381 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-88b44a56-7015-4d6b-b7e4-65862a7a16ee tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:56.297905 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-88b44a56-7015-4d6b-b7e4-65862a7a16ee tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:56.304227 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-88b44a56-7015-4d6b-b7e4-65862a7a16ee tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:56.304678 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-88b44a56-7015-4d6b-b7e4-65862a7a16ee tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:56.305452 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-88b44a56-7015-4d6b-b7e4-65862a7a16ee tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:56.305892 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-88b44a56-7015-4d6b-b7e4-65862a7a16ee tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:56.449533 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-88b44a56-7015-4d6b-b7e4-65862a7a16ee tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:56.457475 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-88b44a56-7015-4d6b-b7e4-65862a7a16ee tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1758 microversion: 2.1 time: 0.164478 Feb 08 16:48:56.458059 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 481/968] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:56 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:57.004721 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c1a48380-aa4a-4ea1-b8da-55f6a86b7fa5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:57.005266 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c1a48380-aa4a-4ea1-b8da-55f6a86b7fa5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:57.011573 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c1a48380-aa4a-4ea1-b8da-55f6a86b7fa5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:57.012064 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c1a48380-aa4a-4ea1-b8da-55f6a86b7fa5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:57.013355 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c1a48380-aa4a-4ea1-b8da-55f6a86b7fa5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:57.014129 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c1a48380-aa4a-4ea1-b8da-55f6a86b7fa5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:57.161303 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c1a48380-aa4a-4ea1-b8da-55f6a86b7fa5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:57.168697 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c1a48380-aa4a-4ea1-b8da-55f6a86b7fa5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.168015 Feb 08 16:48:57.169486 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 488/969] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:56 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:57.474208 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-73f22185-2d4d-4092-90e6-e1f1516cae2d tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:57.474819 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-73f22185-2d4d-4092-90e6-e1f1516cae2d tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:57.481225 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-73f22185-2d4d-4092-90e6-e1f1516cae2d tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:57.482315 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-73f22185-2d4d-4092-90e6-e1f1516cae2d tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:57.483169 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-73f22185-2d4d-4092-90e6-e1f1516cae2d tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:57.483603 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-73f22185-2d4d-4092-90e6-e1f1516cae2d tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:57.629000 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-73f22185-2d4d-4092-90e6-e1f1516cae2d tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:57.636868 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-73f22185-2d4d-4092-90e6-e1f1516cae2d tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1758 microversion: 2.1 time: 0.166386 Feb 08 16:48:57.637442 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 482/970] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:57 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:58.186614 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-05ed729b-f0b8-4749-acbd-963ace930912 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:58.187237 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-05ed729b-f0b8-4749-acbd-963ace930912 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:58.195188 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-05ed729b-f0b8-4749-acbd-963ace930912 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:58.196003 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-05ed729b-f0b8-4749-acbd-963ace930912 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:58.197325 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-05ed729b-f0b8-4749-acbd-963ace930912 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:58.198083 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-05ed729b-f0b8-4749-acbd-963ace930912 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:58.370857 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-05ed729b-f0b8-4749-acbd-963ace930912 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:58.380341 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-05ed729b-f0b8-4749-acbd-963ace930912 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.198355 Feb 08 16:48:58.380946 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 489/971] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:58 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:58.655401 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-50747ecb-da99-4837-aba8-a9c8b1ccf9be tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:58.656040 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-50747ecb-da99-4837-aba8-a9c8b1ccf9be tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:58.662249 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-50747ecb-da99-4837-aba8-a9c8b1ccf9be tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:58.662692 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-50747ecb-da99-4837-aba8-a9c8b1ccf9be tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:58.663460 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-50747ecb-da99-4837-aba8-a9c8b1ccf9be tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:58.663926 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-50747ecb-da99-4837-aba8-a9c8b1ccf9be tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:58.808171 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-50747ecb-da99-4837-aba8-a9c8b1ccf9be tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:58.816902 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-50747ecb-da99-4837-aba8-a9c8b1ccf9be tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1758 microversion: 2.1 time: 0.165410 Feb 08 16:48:58.817478 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 483/972] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:58 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:59.397197 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-17890396-ebe3-4a13-a6db-049a065d2731 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:59.397842 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-17890396-ebe3-4a13-a6db-049a065d2731 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:59.404660 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-17890396-ebe3-4a13-a6db-049a065d2731 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:59.405111 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-17890396-ebe3-4a13-a6db-049a065d2731 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:59.405898 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-17890396-ebe3-4a13-a6db-049a065d2731 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:59.406336 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-17890396-ebe3-4a13-a6db-049a065d2731 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:59.542713 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-17890396-ebe3-4a13-a6db-049a065d2731 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:59.550186 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-17890396-ebe3-4a13-a6db-049a065d2731 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.156597 Feb 08 16:48:59.550750 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 490/973] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:59 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:48:59.834353 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-cd98e428-251b-431c-a4fd-2aff0379d237 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:48:59.834966 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-cd98e428-251b-431c-a4fd-2aff0379d237 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:48:59.841475 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cd98e428-251b-431c-a4fd-2aff0379d237 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:59.841921 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cd98e428-251b-431c-a4fd-2aff0379d237 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:59.842693 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cd98e428-251b-431c-a4fd-2aff0379d237 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:48:59.843156 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cd98e428-251b-431c-a4fd-2aff0379d237 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:48:59.988095 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-cd98e428-251b-431c-a4fd-2aff0379d237 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:48:59.995986 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-cd98e428-251b-431c-a4fd-2aff0379d237 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1758 microversion: 2.1 time: 0.165288 Feb 08 16:48:59.996564 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 484/974] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:48:59 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:00.112718 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-4395252f-6264-4391-9a44-fddfc1764428 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:00.113189 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-4395252f-6264-4391-9a44-fddfc1764428 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:00.119096 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4395252f-6264-4391-9a44-fddfc1764428 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:00.119551 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4395252f-6264-4391-9a44-fddfc1764428 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:00.120359 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4395252f-6264-4391-9a44-fddfc1764428 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:00.120801 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4395252f-6264-4391-9a44-fddfc1764428 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:00.149215 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-4395252f-6264-4391-9a44-fddfc1764428 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments/56e1f198-eaa4-4162-bc65-1afdb8be0c15" status: 200 len: 194 microversion: 2.20 time: 0.040378 Feb 08 16:49:00.149790 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 491/975] 10.222.0.35 () {60 vars in 1453 bytes} [Tue Feb 8 16:49:00 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments/56e1f198-eaa4-4162-bc65-1afdb8be0c15 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:49:00.210257 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-933e6fb8-3a80-489f-aa38-25ab09bfb8ed tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:00.210749 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-933e6fb8-3a80-489f-aa38-25ab09bfb8ed tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:00.217179 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-933e6fb8-3a80-489f-aa38-25ab09bfb8ed tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:00.217620 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-933e6fb8-3a80-489f-aa38-25ab09bfb8ed tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:00.218383 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-933e6fb8-3a80-489f-aa38-25ab09bfb8ed tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:00.218831 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-933e6fb8-3a80-489f-aa38-25ab09bfb8ed tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:00.295332 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.objects.instance [None req-933e6fb8-3a80-489f-aa38-25ab09bfb8ed tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lazy-loading 'services' on Instance uuid da00c476-8246-413e-889c-d22fe63e2ef8 {{(pid=122901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:49:00.365339 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-933e6fb8-3a80-489f-aa38-25ab09bfb8ed tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "DELETE /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments/56e1f198-eaa4-4162-bc65-1afdb8be0c15" status: 202 len: 0 microversion: 2.20 time: 0.158726 Feb 08 16:49:00.365885 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 485/976] 10.222.0.35 () {60 vars in 1456 bytes} [Tue Feb 8 16:49:00 2022] DELETE /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments/56e1f198-eaa4-4162-bc65-1afdb8be0c15 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 08 16:49:00.374300 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-08dc506a-0b9b-4152-a602-f2a2b0ab0a4d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:00.375499 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-08dc506a-0b9b-4152-a602-f2a2b0ab0a4d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:00.381481 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-08dc506a-0b9b-4152-a602-f2a2b0ab0a4d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:00.381960 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-08dc506a-0b9b-4152-a602-f2a2b0ab0a4d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:00.382924 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-08dc506a-0b9b-4152-a602-f2a2b0ab0a4d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:00.383374 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-08dc506a-0b9b-4152-a602-f2a2b0ab0a4d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:00.414018 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-08dc506a-0b9b-4152-a602-f2a2b0ab0a4d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043804 Feb 08 16:49:00.416801 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 492/977] 10.222.0.35 () {60 vars in 1342 bytes} [Tue Feb 8 16:49:00 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:49:00.566658 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-97e3b8e8-0299-43f9-96d0-cc9524057d3d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:00.567355 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-97e3b8e8-0299-43f9-96d0-cc9524057d3d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:00.573506 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-97e3b8e8-0299-43f9-96d0-cc9524057d3d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:00.573959 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-97e3b8e8-0299-43f9-96d0-cc9524057d3d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:00.574729 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-97e3b8e8-0299-43f9-96d0-cc9524057d3d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:00.575701 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-97e3b8e8-0299-43f9-96d0-cc9524057d3d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:00.711652 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-97e3b8e8-0299-43f9-96d0-cc9524057d3d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:00.719654 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-97e3b8e8-0299-43f9-96d0-cc9524057d3d tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.157046 Feb 08 16:49:00.720271 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 486/978] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:00 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:01.014238 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-dd7b418f-dc0f-40a9-a908-5918f533f480 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:01.014860 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-dd7b418f-dc0f-40a9-a908-5918f533f480 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:01.024997 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dd7b418f-dc0f-40a9-a908-5918f533f480 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:01.025480 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dd7b418f-dc0f-40a9-a908-5918f533f480 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:01.026293 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dd7b418f-dc0f-40a9-a908-5918f533f480 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:01.026737 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dd7b418f-dc0f-40a9-a908-5918f533f480 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:01.169399 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-dd7b418f-dc0f-40a9-a908-5918f533f480 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:01.177259 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-dd7b418f-dc0f-40a9-a908-5918f533f480 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1758 microversion: 2.1 time: 0.167547 Feb 08 16:49:01.177833 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 493/979] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:01 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:01.426208 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-711b6c95-b6b2-45a5-b0cb-392ae7ec02a8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:01.427187 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-711b6c95-b6b2-45a5-b0cb-392ae7ec02a8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:01.433475 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-711b6c95-b6b2-45a5-b0cb-392ae7ec02a8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:01.433929 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-711b6c95-b6b2-45a5-b0cb-392ae7ec02a8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:01.435575 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-711b6c95-b6b2-45a5-b0cb-392ae7ec02a8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:01.436096 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-711b6c95-b6b2-45a5-b0cb-392ae7ec02a8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:01.464374 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-711b6c95-b6b2-45a5-b0cb-392ae7ec02a8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042048 Feb 08 16:49:01.464920 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 487/980] 10.222.0.35 () {60 vars in 1342 bytes} [Tue Feb 8 16:49:01 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 08 16:49:01.737274 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-f21aea1c-2a35-490f-bcfc-f546e0b31bc7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:01.737892 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-f21aea1c-2a35-490f-bcfc-f546e0b31bc7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:01.744343 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f21aea1c-2a35-490f-bcfc-f546e0b31bc7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:01.744800 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f21aea1c-2a35-490f-bcfc-f546e0b31bc7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:01.745588 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f21aea1c-2a35-490f-bcfc-f546e0b31bc7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:01.746034 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-f21aea1c-2a35-490f-bcfc-f546e0b31bc7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:01.879534 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-f21aea1c-2a35-490f-bcfc-f546e0b31bc7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:01.887126 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-f21aea1c-2a35-490f-bcfc-f546e0b31bc7 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.153860 Feb 08 16:49:01.887698 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 494/981] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:01 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:02.194004 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e109eede-d2de-4ba1-802f-c0e036850cf1 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:02.194644 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e109eede-d2de-4ba1-802f-c0e036850cf1 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:02.201070 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e109eede-d2de-4ba1-802f-c0e036850cf1 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:02.201593 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e109eede-d2de-4ba1-802f-c0e036850cf1 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:02.202387 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e109eede-d2de-4ba1-802f-c0e036850cf1 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:02.202845 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e109eede-d2de-4ba1-802f-c0e036850cf1 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:02.349028 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e109eede-d2de-4ba1-802f-c0e036850cf1 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:02.357600 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e109eede-d2de-4ba1-802f-c0e036850cf1 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1758 microversion: 2.1 time: 0.167170 Feb 08 16:49:02.358200 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 488/982] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:02 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:02.476116 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-1b3aa628-d6bf-4b47-88d9-c20433a88c98 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:02.477087 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-1b3aa628-d6bf-4b47-88d9-c20433a88c98 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:02.483499 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1b3aa628-d6bf-4b47-88d9-c20433a88c98 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:02.484056 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1b3aa628-d6bf-4b47-88d9-c20433a88c98 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:02.484858 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1b3aa628-d6bf-4b47-88d9-c20433a88c98 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:02.485302 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1b3aa628-d6bf-4b47-88d9-c20433a88c98 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:02.514383 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-1b3aa628-d6bf-4b47-88d9-c20433a88c98 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042029 Feb 08 16:49:02.514944 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 495/983] 10.222.0.35 () {60 vars in 1342 bytes} [Tue Feb 8 16:49:02 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:49:02.904731 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-956f14f5-2b95-419d-a7f7-cd53cfb9d3ef tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:02.905371 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-956f14f5-2b95-419d-a7f7-cd53cfb9d3ef tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:02.912088 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-956f14f5-2b95-419d-a7f7-cd53cfb9d3ef tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:02.912539 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-956f14f5-2b95-419d-a7f7-cd53cfb9d3ef tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:02.913325 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-956f14f5-2b95-419d-a7f7-cd53cfb9d3ef tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:02.913759 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-956f14f5-2b95-419d-a7f7-cd53cfb9d3ef tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:03.048600 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-956f14f5-2b95-419d-a7f7-cd53cfb9d3ef tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:03.055890 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-956f14f5-2b95-419d-a7f7-cd53cfb9d3ef tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.155581 Feb 08 16:49:03.056455 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 489/984] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:02 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:03.374581 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-23bae739-fcfe-44a4-8612-998fbd3ddb34 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:03.375434 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-23bae739-fcfe-44a4-8612-998fbd3ddb34 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:03.381887 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-23bae739-fcfe-44a4-8612-998fbd3ddb34 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:03.382335 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-23bae739-fcfe-44a4-8612-998fbd3ddb34 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:03.383119 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-23bae739-fcfe-44a4-8612-998fbd3ddb34 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:03.383549 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-23bae739-fcfe-44a4-8612-998fbd3ddb34 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:03.526215 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-574711c7-9568-499e-9601-126cdd01af55 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:03.527159 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-574711c7-9568-499e-9601-126cdd01af55 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:03.533511 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-574711c7-9568-499e-9601-126cdd01af55 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:03.534018 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-574711c7-9568-499e-9601-126cdd01af55 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:03.534869 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-574711c7-9568-499e-9601-126cdd01af55 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:03.535311 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-574711c7-9568-499e-9601-126cdd01af55 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:03.536374 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-23bae739-fcfe-44a4-8612-998fbd3ddb34 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:03.545081 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-23bae739-fcfe-44a4-8612-998fbd3ddb34 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1758 microversion: 2.1 time: 0.174575 Feb 08 16:49:03.546164 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 496/985] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:03 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:03.567362 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-574711c7-9568-499e-9601-126cdd01af55 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044890 Feb 08 16:49:03.567960 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 490/986] 10.222.0.35 () {60 vars in 1342 bytes} [Tue Feb 8 16:49:03 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 08 16:49:04.072509 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-9ebec141-49c7-4f61-8dd9-819839b34bf5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:04.073130 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-9ebec141-49c7-4f61-8dd9-819839b34bf5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:04.079167 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9ebec141-49c7-4f61-8dd9-819839b34bf5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:04.079621 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9ebec141-49c7-4f61-8dd9-819839b34bf5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:04.080438 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9ebec141-49c7-4f61-8dd9-819839b34bf5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:04.080883 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9ebec141-49c7-4f61-8dd9-819839b34bf5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:04.216623 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9ebec141-49c7-4f61-8dd9-819839b34bf5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:04.223883 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-9ebec141-49c7-4f61-8dd9-819839b34bf5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.155009 Feb 08 16:49:04.224452 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 497/987] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:04 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:04.562394 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-f0a6a428-fd19-4430-84cd-d3abfa350587 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:04.562925 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-f0a6a428-fd19-4430-84cd-d3abfa350587 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:04.569240 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f0a6a428-fd19-4430-84cd-d3abfa350587 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:04.569694 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f0a6a428-fd19-4430-84cd-d3abfa350587 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:04.570477 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f0a6a428-fd19-4430-84cd-d3abfa350587 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:04.570916 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f0a6a428-fd19-4430-84cd-d3abfa350587 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:04.579277 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-23e44051-d9cb-4cad-b37e-75b1c10b5970 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:04.580366 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-23e44051-d9cb-4cad-b37e-75b1c10b5970 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:04.586905 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-23e44051-d9cb-4cad-b37e-75b1c10b5970 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:04.587356 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-23e44051-d9cb-4cad-b37e-75b1c10b5970 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:04.588168 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-23e44051-d9cb-4cad-b37e-75b1c10b5970 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:04.588608 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-23e44051-d9cb-4cad-b37e-75b1c10b5970 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:04.620322 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-23e44051-d9cb-4cad-b37e-75b1c10b5970 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045671 Feb 08 16:49:04.620897 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 498/988] 10.222.0.35 () {60 vars in 1342 bytes} [Tue Feb 8 16:49:04 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:49:04.721501 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f0a6a428-fd19-4430-84cd-d3abfa350587 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:04.729487 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-f0a6a428-fd19-4430-84cd-d3abfa350587 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1758 microversion: 2.1 time: 0.171010 Feb 08 16:49:04.730060 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 491/989] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:04 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:05.241257 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-cf91f030-6b0b-42d6-b3f6-fb805deff811 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:05.241874 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-cf91f030-6b0b-42d6-b3f6-fb805deff811 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:05.248400 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cf91f030-6b0b-42d6-b3f6-fb805deff811 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:05.248876 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cf91f030-6b0b-42d6-b3f6-fb805deff811 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:05.249660 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cf91f030-6b0b-42d6-b3f6-fb805deff811 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:05.250097 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cf91f030-6b0b-42d6-b3f6-fb805deff811 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:05.387993 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-cf91f030-6b0b-42d6-b3f6-fb805deff811 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:05.395141 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-cf91f030-6b0b-42d6-b3f6-fb805deff811 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.157572 Feb 08 16:49:05.395705 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 499/990] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:05 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:05.631883 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-69ba933a-e3aa-436c-a817-23b388d76b0f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:05.632832 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-69ba933a-e3aa-436c-a817-23b388d76b0f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:05.639362 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-69ba933a-e3aa-436c-a817-23b388d76b0f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:05.639849 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-69ba933a-e3aa-436c-a817-23b388d76b0f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:05.640630 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-69ba933a-e3aa-436c-a817-23b388d76b0f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:05.641065 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-69ba933a-e3aa-436c-a817-23b388d76b0f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:05.670933 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-69ba933a-e3aa-436c-a817-23b388d76b0f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042856 Feb 08 16:49:05.671490 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 492/991] 10.222.0.35 () {60 vars in 1342 bytes} [Tue Feb 8 16:49:05 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:49:05.746062 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b0ca45f4-9f7e-428f-9d8c-fb300bd38efb tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:05.746657 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b0ca45f4-9f7e-428f-9d8c-fb300bd38efb tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:05.753157 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b0ca45f4-9f7e-428f-9d8c-fb300bd38efb tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:05.753616 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b0ca45f4-9f7e-428f-9d8c-fb300bd38efb tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:05.754464 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b0ca45f4-9f7e-428f-9d8c-fb300bd38efb tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:05.754905 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b0ca45f4-9f7e-428f-9d8c-fb300bd38efb tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:05.977048 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b0ca45f4-9f7e-428f-9d8c-fb300bd38efb tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:05.985018 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b0ca45f4-9f7e-428f-9d8c-fb300bd38efb tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1758 microversion: 2.1 time: 0.242533 Feb 08 16:49:05.985608 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 500/992] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:05 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1758 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:06.412751 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-25e59d6b-ed44-4079-8237-f4cca170b4cb tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:06.413367 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-25e59d6b-ed44-4079-8237-f4cca170b4cb tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:06.419232 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-25e59d6b-ed44-4079-8237-f4cca170b4cb tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:06.419681 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-25e59d6b-ed44-4079-8237-f4cca170b4cb tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:06.421188 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-25e59d6b-ed44-4079-8237-f4cca170b4cb tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:06.421620 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-25e59d6b-ed44-4079-8237-f4cca170b4cb tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:06.557107 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-25e59d6b-ed44-4079-8237-f4cca170b4cb tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:06.564877 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-25e59d6b-ed44-4079-8237-f4cca170b4cb tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.155832 Feb 08 16:49:06.565381 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 493/993] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:06 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:49:06.682815 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-862f99b8-9068-4d6c-bd59-fcf05c7600c7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:06.683724 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-862f99b8-9068-4d6c-bd59-fcf05c7600c7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:06.689678 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-862f99b8-9068-4d6c-bd59-fcf05c7600c7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:06.690126 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-862f99b8-9068-4d6c-bd59-fcf05c7600c7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:06.690894 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-862f99b8-9068-4d6c-bd59-fcf05c7600c7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:06.691326 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-862f99b8-9068-4d6c-bd59-fcf05c7600c7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:06.720708 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-862f99b8-9068-4d6c-bd59-fcf05c7600c7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041747 Feb 08 16:49:06.721254 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 501/994] 10.222.0.35 () {60 vars in 1342 bytes} [Tue Feb 8 16:49:06 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:49:07.002753 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-02d048fa-272c-424d-8912-988c628bf709 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:07.003333 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-02d048fa-272c-424d-8912-988c628bf709 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:07.009715 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-02d048fa-272c-424d-8912-988c628bf709 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:07.010161 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-02d048fa-272c-424d-8912-988c628bf709 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:07.010933 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-02d048fa-272c-424d-8912-988c628bf709 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:07.011361 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-02d048fa-272c-424d-8912-988c628bf709 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:07.303167 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-02d048fa-272c-424d-8912-988c628bf709 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:07.311726 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-02d048fa-272c-424d-8912-988c628bf709 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1761 microversion: 2.1 time: 0.312827 Feb 08 16:49:07.312324 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 494/995] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:06 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1761 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:07.581425 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-0cac0d46-7fe2-4c76-a3b2-79498c9ffa33 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:07.582037 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-0cac0d46-7fe2-4c76-a3b2-79498c9ffa33 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:07.588335 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0cac0d46-7fe2-4c76-a3b2-79498c9ffa33 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:07.588782 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0cac0d46-7fe2-4c76-a3b2-79498c9ffa33 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:07.589549 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0cac0d46-7fe2-4c76-a3b2-79498c9ffa33 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:07.589980 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0cac0d46-7fe2-4c76-a3b2-79498c9ffa33 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:07.724227 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-0cac0d46-7fe2-4c76-a3b2-79498c9ffa33 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:07.731589 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-0cac0d46-7fe2-4c76-a3b2-79498c9ffa33 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.153798 Feb 08 16:49:07.732136 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-3023e700-a4e7-4e3b-b5bc-acaebd032e1e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:07.732303 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 502/996] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:07 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:07.733873 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-3023e700-a4e7-4e3b-b5bc-acaebd032e1e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:07.739772 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3023e700-a4e7-4e3b-b5bc-acaebd032e1e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:07.740316 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3023e700-a4e7-4e3b-b5bc-acaebd032e1e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:07.741171 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3023e700-a4e7-4e3b-b5bc-acaebd032e1e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:07.741879 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3023e700-a4e7-4e3b-b5bc-acaebd032e1e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:07.770138 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-3023e700-a4e7-4e3b-b5bc-acaebd032e1e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041826 Feb 08 16:49:07.770681 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 495/997] 10.222.0.35 () {60 vars in 1342 bytes} [Tue Feb 8 16:49:07 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 08 16:49:08.781742 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d82a530f-2f06-424a-b8b4-466a25429d6a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:08.782671 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-d82a530f-2f06-424a-b8b4-466a25429d6a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:08.789093 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d82a530f-2f06-424a-b8b4-466a25429d6a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:08.789546 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d82a530f-2f06-424a-b8b4-466a25429d6a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:08.790339 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d82a530f-2f06-424a-b8b4-466a25429d6a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:08.790779 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d82a530f-2f06-424a-b8b4-466a25429d6a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:08.820747 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d82a530f-2f06-424a-b8b4-466a25429d6a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042965 Feb 08 16:49:08.821313 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 496/998] 10.222.0.35 () {60 vars in 1342 bytes} [Tue Feb 8 16:49:08 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 08 16:49:08.964142 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-4d98d94e-6e05-4751-8123-03f855562fdb tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:08.965180 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-4d98d94e-6e05-4751-8123-03f855562fdb tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:08.970672 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4d98d94e-6e05-4751-8123-03f855562fdb tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:08.971133 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4d98d94e-6e05-4751-8123-03f855562fdb tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:08.971953 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4d98d94e-6e05-4751-8123-03f855562fdb tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:08.972399 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4d98d94e-6e05-4751-8123-03f855562fdb tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:09.012843 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-a3126a76-750e-4078-81b7-abe8930ef6a3 req-6852a19b-1e8e-40e5-bc6e-81ae92b92799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f5b0dab-9c28-4519-a6f6-c98d7c9a5287", "name": "network-vif-unplugged", "status": "completed", "tag": "6f04fb2f-d81d-42f0-8c53-184ef0859a38"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:49:09.014693 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:49:09.014693 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:49:09.023133 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-a3126a76-750e-4078-81b7-abe8930ef6a3 req-6852a19b-1e8e-40e5-bc6e-81ae92b92799 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:09.023576 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-a3126a76-750e-4078-81b7-abe8930ef6a3 req-6852a19b-1e8e-40e5-bc6e-81ae92b92799 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:09.037125 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-a3126a76-750e-4078-81b7-abe8930ef6a3 req-6852a19b-1e8e-40e5-bc6e-81ae92b92799 service nova] Creating event network-vif-unplugged:6f04fb2f-d81d-42f0-8c53-184ef0859a38 for instance 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 on hv-cinder-82786 Feb 08 16:49:09.042316 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-a3126a76-750e-4078-81b7-abe8930ef6a3 req-6852a19b-1e8e-40e5-bc6e-81ae92b92799 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032944 Feb 08 16:49:09.043229 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 497/999] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:49:09.116299 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-4d98d94e-6e05-4751-8123-03f855562fdb tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:09.123766 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-4d98d94e-6e05-4751-8123-03f855562fdb tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.377909 Feb 08 16:49:09.124348 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 503/1000] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:08 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:09.834101 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-14015484-9d71-4da0-b688-e9948999bafd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:09.835091 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-14015484-9d71-4da0-b688-e9948999bafd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:09.841198 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-14015484-9d71-4da0-b688-e9948999bafd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:09.841650 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-14015484-9d71-4da0-b688-e9948999bafd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:09.842572 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-14015484-9d71-4da0-b688-e9948999bafd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:09.843018 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-14015484-9d71-4da0-b688-e9948999bafd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:09.870638 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-14015484-9d71-4da0-b688-e9948999bafd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041238 Feb 08 16:49:09.871172 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 498/1001] 10.222.0.35 () {60 vars in 1342 bytes} [Tue Feb 8 16:49:09 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:49:10.140808 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-73a46db6-0a94-4e5a-a918-d82afdc3b5d9 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:10.141361 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-73a46db6-0a94-4e5a-a918-d82afdc3b5d9 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:10.147574 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-73a46db6-0a94-4e5a-a918-d82afdc3b5d9 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:10.148057 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-73a46db6-0a94-4e5a-a918-d82afdc3b5d9 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:10.148839 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-73a46db6-0a94-4e5a-a918-d82afdc3b5d9 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:10.149270 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-73a46db6-0a94-4e5a-a918-d82afdc3b5d9 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:10.287148 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-73a46db6-0a94-4e5a-a918-d82afdc3b5d9 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:10.295479 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-73a46db6-0a94-4e5a-a918-d82afdc3b5d9 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.158505 Feb 08 16:49:10.296114 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 504/1002] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:10 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:10.882517 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-7ecee383-c3b8-44b0-877f-6682613f91b0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:10.883427 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7ecee383-c3b8-44b0-877f-6682613f91b0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:10.890391 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7ecee383-c3b8-44b0-877f-6682613f91b0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:10.890844 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7ecee383-c3b8-44b0-877f-6682613f91b0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:10.891625 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7ecee383-c3b8-44b0-877f-6682613f91b0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:10.892089 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7ecee383-c3b8-44b0-877f-6682613f91b0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:10.921028 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-7ecee383-c3b8-44b0-877f-6682613f91b0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042245 Feb 08 16:49:10.921585 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 499/1003] 10.222.0.35 () {60 vars in 1342 bytes} [Tue Feb 8 16:49:10 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:10.977188 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-18528d73-0a11-49d2-821e-6291d903f549 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:10.977690 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-18528d73-0a11-49d2-821e-6291d903f549 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:10.984879 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-18528d73-0a11-49d2-821e-6291d903f549 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:10.985338 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-18528d73-0a11-49d2-821e-6291d903f549 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:10.986299 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-18528d73-0a11-49d2-821e-6291d903f549 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:10.986745 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-18528d73-0a11-49d2-821e-6291d903f549 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:11.021265 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-18528d73-0a11-49d2-821e-6291d903f549 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Going to try to terminate instance {{(pid=122902) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 16:49:11.098779 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-18528d73-0a11-49d2-821e-6291d903f549 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "DELETE /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 204 len: 0 microversion: 2.20 time: 0.125010 Feb 08 16:49:11.099503 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 505/1004] 10.222.0.35 () {60 vars in 1279 bytes} [Tue Feb 8 16:49:10 2022] DELETE /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 08 16:49:11.108160 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-c532899a-49a2-48cb-80af-0ec0bcf10d48 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:11.109075 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-c532899a-49a2-48cb-80af-0ec0bcf10d48 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:11.115075 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c532899a-49a2-48cb-80af-0ec0bcf10d48 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:11.115518 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c532899a-49a2-48cb-80af-0ec0bcf10d48 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:11.116331 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c532899a-49a2-48cb-80af-0ec0bcf10d48 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:11.116785 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c532899a-49a2-48cb-80af-0ec0bcf10d48 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:11.252743 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c532899a-49a2-48cb-80af-0ec0bcf10d48 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:11.260571 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c532899a-49a2-48cb-80af-0ec0bcf10d48 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:11.262084 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c532899a-49a2-48cb-80af-0ec0bcf10d48 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:11.263250 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-c532899a-49a2-48cb-80af-0ec0bcf10d48 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1722 microversion: 2.20 time: 0.159397 Feb 08 16:49:11.264179 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 500/1005] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:49:11 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:49:11.313334 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-2b7430b4-e425-4c91-81d4-0f7aaa99f4d3 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:11.314051 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-2b7430b4-e425-4c91-81d4-0f7aaa99f4d3 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:11.320333 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2b7430b4-e425-4c91-81d4-0f7aaa99f4d3 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:11.320789 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2b7430b4-e425-4c91-81d4-0f7aaa99f4d3 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:11.321582 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2b7430b4-e425-4c91-81d4-0f7aaa99f4d3 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:11.322024 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2b7430b4-e425-4c91-81d4-0f7aaa99f4d3 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:11.457912 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-2b7430b4-e425-4c91-81d4-0f7aaa99f4d3 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:11.465282 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-2b7430b4-e425-4c91-81d4-0f7aaa99f4d3 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1507 microversion: 2.1 time: 0.156806 Feb 08 16:49:11.465845 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 506/1006] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:11 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:11.481641 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-191cd777-b0a1-4e12-a9b0-b99f94ba4bea tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:49:11.482211 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-191cd777-b0a1-4e12-a9b0-b99f94ba4bea tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:11.488788 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-191cd777-b0a1-4e12-a9b0-b99f94ba4bea tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:11.489239 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-191cd777-b0a1-4e12-a9b0-b99f94ba4bea tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:11.490019 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-191cd777-b0a1-4e12-a9b0-b99f94ba4bea tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:11.490457 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-191cd777-b0a1-4e12-a9b0-b99f94ba4bea tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:11.563852 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-191cd777-b0a1-4e12-a9b0-b99f94ba4bea tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "POST /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287/action" status: 202 len: 0 microversion: 2.1 time: 0.085796 Feb 08 16:49:11.564440 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 501/1007] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Feb 8 16:49:11 2022] POST /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:49:11.572093 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-1dd72e49-8f89-4152-b441-53e914f7fa03 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:11.572702 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-1dd72e49-8f89-4152-b441-53e914f7fa03 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:11.578385 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1dd72e49-8f89-4152-b441-53e914f7fa03 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:11.578830 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1dd72e49-8f89-4152-b441-53e914f7fa03 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:11.579603 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1dd72e49-8f89-4152-b441-53e914f7fa03 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:11.580061 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1dd72e49-8f89-4152-b441-53e914f7fa03 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:11.726559 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-1dd72e49-8f89-4152-b441-53e914f7fa03 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:11.734360 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-1dd72e49-8f89-4152-b441-53e914f7fa03 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1515 microversion: 2.1 time: 0.165830 Feb 08 16:49:11.734932 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 507/1008] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:11 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:12.282152 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-332e9b5d-28f1-4e8f-a066-5df2c4d62f4a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:12.282754 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-332e9b5d-28f1-4e8f-a066-5df2c4d62f4a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:12.288558 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-332e9b5d-28f1-4e8f-a066-5df2c4d62f4a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:12.289021 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-332e9b5d-28f1-4e8f-a066-5df2c4d62f4a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:12.289798 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-332e9b5d-28f1-4e8f-a066-5df2c4d62f4a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:12.290227 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-332e9b5d-28f1-4e8f-a066-5df2c4d62f4a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:12.424654 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-332e9b5d-28f1-4e8f-a066-5df2c4d62f4a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:12.432280 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-332e9b5d-28f1-4e8f-a066-5df2c4d62f4a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:12.433749 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-332e9b5d-28f1-4e8f-a066-5df2c4d62f4a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:12.434883 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-332e9b5d-28f1-4e8f-a066-5df2c4d62f4a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1722 microversion: 2.20 time: 0.157333 Feb 08 16:49:12.435484 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 502/1009] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:49:12 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:49:12.752470 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-099bc54d-7c15-4311-b780-9d22aaa4f974 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:12.753116 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-099bc54d-7c15-4311-b780-9d22aaa4f974 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:12.759475 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-099bc54d-7c15-4311-b780-9d22aaa4f974 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:12.759980 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-099bc54d-7c15-4311-b780-9d22aaa4f974 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:12.760771 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-099bc54d-7c15-4311-b780-9d22aaa4f974 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:12.761493 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-099bc54d-7c15-4311-b780-9d22aaa4f974 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:12.908336 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-099bc54d-7c15-4311-b780-9d22aaa4f974 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:12.915669 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-099bc54d-7c15-4311-b780-9d22aaa4f974 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1517 microversion: 2.1 time: 0.167849 Feb 08 16:49:12.916267 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 508/1010] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:12 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:13.457401 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-f2e26d36-0a93-42be-ac9d-09571ce7151c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:13.458101 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-f2e26d36-0a93-42be-ac9d-09571ce7151c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:13.464052 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f2e26d36-0a93-42be-ac9d-09571ce7151c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:13.464503 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f2e26d36-0a93-42be-ac9d-09571ce7151c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:13.465285 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f2e26d36-0a93-42be-ac9d-09571ce7151c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:13.465766 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f2e26d36-0a93-42be-ac9d-09571ce7151c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:13.700465 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f2e26d36-0a93-42be-ac9d-09571ce7151c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:13.709451 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f2e26d36-0a93-42be-ac9d-09571ce7151c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:13.710947 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f2e26d36-0a93-42be-ac9d-09571ce7151c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:13.712144 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-f2e26d36-0a93-42be-ac9d-09571ce7151c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 200 len: 1722 microversion: 2.20 time: 0.258675 Feb 08 16:49:13.712700 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 503/1011] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:49:13 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:49:13.934320 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-ab98ce0d-fbe8-49e5-9649-3cc42a84734f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:13.934936 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-ab98ce0d-fbe8-49e5-9649-3cc42a84734f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:13.942342 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ab98ce0d-fbe8-49e5-9649-3cc42a84734f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:13.943085 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ab98ce0d-fbe8-49e5-9649-3cc42a84734f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:13.943854 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ab98ce0d-fbe8-49e5-9649-3cc42a84734f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:13.944297 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ab98ce0d-fbe8-49e5-9649-3cc42a84734f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:14.094041 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-ccda43e3-f1af-4dc1-9906-a7b1e5b59de6 req-65b69ffe-82ba-4b89-9976-24b8b1a4c452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da00c476-8246-413e-889c-d22fe63e2ef8", "name": "network-vif-deleted", "tag": "dc601835-5363-4bdf-9b05-9e711057cbd2"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:49:14.097097 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:49:14.097097 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:49:14.104128 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ab98ce0d-fbe8-49e5-9649-3cc42a84734f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:14.116257 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-ab98ce0d-fbe8-49e5-9649-3cc42a84734f tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1573 microversion: 2.1 time: 0.185535 Feb 08 16:49:14.116477 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-ccda43e3-f1af-4dc1-9906-a7b1e5b59de6 req-65b69ffe-82ba-4b89-9976-24b8b1a4c452 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:14.117927 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-ccda43e3-f1af-4dc1-9906-a7b1e5b59de6 req-65b69ffe-82ba-4b89-9976-24b8b1a4c452 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:14.120096 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 509/1012] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:13 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1573 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:14.132779 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-ccda43e3-f1af-4dc1-9906-a7b1e5b59de6 req-65b69ffe-82ba-4b89-9976-24b8b1a4c452 service nova] Creating event network-vif-deleted:dc601835-5363-4bdf-9b05-9e711057cbd2 for instance da00c476-8246-413e-889c-d22fe63e2ef8 on hv-cinder-82786 Feb 08 16:49:14.137933 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-ccda43e3-f1af-4dc1-9906-a7b1e5b59de6 req-65b69ffe-82ba-4b89-9976-24b8b1a4c452 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054604 Feb 08 16:49:14.139016 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 504/1013] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:49:14.730634 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-931175ad-2a70-4770-8b82-33274e5182d1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:14.731248 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-931175ad-2a70-4770-8b82-33274e5182d1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:14.743122 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-931175ad-2a70-4770-8b82-33274e5182d1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:14.743925 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-931175ad-2a70-4770-8b82-33274e5182d1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:14.745153 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-931175ad-2a70-4770-8b82-33274e5182d1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:14.745717 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-931175ad-2a70-4770-8b82-33274e5182d1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:14.762141 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-931175ad-2a70-4770-8b82-33274e5182d1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] HTTP exception thrown: Instance da00c476-8246-413e-889c-d22fe63e2ef8 could not be found. Feb 08 16:49:14.762743 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-931175ad-2a70-4770-8b82-33274e5182d1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Returning 404 to user: Instance da00c476-8246-413e-889c-d22fe63e2ef8 could not be found. {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:49:14.764207 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-931175ad-2a70-4770-8b82-33274e5182d1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 404 len: 111 microversion: 2.20 time: 0.036792 Feb 08 16:49:14.764964 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 510/1014] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:49:14 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 08 16:49:14.774199 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-34475c5c-d1f4-4b1b-8d82-d9702c513bad tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '.version_select at 0x7fcde00b44c0>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:14.795806 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-34475c5c-d1f4-4b1b-8d82-d9702c513bad tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-181098442" status: 204 len: 0 microversion: 2.20 time: 0.025979 Feb 08 16:49:14.799848 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 505/1015] 10.222.0.35 () {60 vars in 1258 bytes} [Tue Feb 8 16:49:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-181098442 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 08 16:49:15.134267 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-d49a32b7-8d7c-4840-bd34-d9ffe5ac6ad6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:15.135679 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-d49a32b7-8d7c-4840-bd34-d9ffe5ac6ad6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:15.143989 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d49a32b7-8d7c-4840-bd34-d9ffe5ac6ad6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:15.144877 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d49a32b7-8d7c-4840-bd34-d9ffe5ac6ad6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:15.145834 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d49a32b7-8d7c-4840-bd34-d9ffe5ac6ad6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:15.146391 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d49a32b7-8d7c-4840-bd34-d9ffe5ac6ad6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:15.301858 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-d49a32b7-8d7c-4840-bd34-d9ffe5ac6ad6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:15.310072 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-d49a32b7-8d7c-4840-bd34-d9ffe5ac6ad6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1573 microversion: 2.1 time: 0.179848 Feb 08 16:49:15.311153 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 511/1016] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:15 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1573 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:15.734053 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-613fd787-7de1-47af-bb09-6c10c24d8636 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Action: 'create', calling method: .version_select at 0x7fcde01ddaf0>, body: {"keypair": {"name": "tempest-keypair-547000072"}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:49:15.748337 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-613fd787-7de1-47af-bb09-6c10c24d8636 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Getting quotas for project 23325df6a88748fc9261e22c093ac67e. Resources: {'key_pairs'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:49:15.752442 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-613fd787-7de1-47af-bb09-6c10c24d8636 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Getting quotas for user c858d129681846aba9e366c37c2213a0 and project 23325df6a88748fc9261e22c093ac67e. Resources: {'key_pairs'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:49:16.124266 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-613fd787-7de1-47af-bb09-6c10c24d8636 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Getting quotas for project 23325df6a88748fc9261e22c093ac67e. Resources: {'key_pairs'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:49:16.128362 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-613fd787-7de1-47af-bb09-6c10c24d8636 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Getting quotas for user c858d129681846aba9e366c37c2213a0 and project 23325df6a88748fc9261e22c093ac67e. Resources: {'key_pairs'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:49:16.141788 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-613fd787-7de1-47af-bb09-6c10c24d8636 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.411739 Feb 08 16:49:16.142614 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 506/1017] 10.222.0.35 () {62 vars in 1198 bytes} [Tue Feb 8 16:49:15 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 413 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 08 16:49:16.330608 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-35248cc9-10a3-4b6d-a10f-1ab354d061d3 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:16.331967 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-35248cc9-10a3-4b6d-a10f-1ab354d061d3 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:16.342448 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-35248cc9-10a3-4b6d-a10f-1ab354d061d3 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:16.343168 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-35248cc9-10a3-4b6d-a10f-1ab354d061d3 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:16.344618 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-35248cc9-10a3-4b6d-a10f-1ab354d061d3 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:16.345909 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-35248cc9-10a3-4b6d-a10f-1ab354d061d3 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:16.542366 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-35248cc9-10a3-4b6d-a10f-1ab354d061d3 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:16.553748 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-35248cc9-10a3-4b6d-a10f-1ab354d061d3 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1573 microversion: 2.1 time: 0.228665 Feb 08 16:49:16.554326 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 512/1018] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:16 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1573 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:17.533297 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-27fb7ddf-0734-4cf2-8272-e3b4be7a114e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-766048128", "imageRef": "d70d3911-14f2-4cba-9283-bf4bef4fb526", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64dd4aa3-e414-467b-84ff-dc68d3d652e1"}], "security_groups": [{"name": "tempest-securitygroup--170249488"}], "key_name": "tempest-keypair-547000072", "user_data": "}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:49:17.570845 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-fb42ec85-2508-42c3-98ac-96a0ef88e6f5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:17.571553 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-fb42ec85-2508-42c3-98ac-96a0ef88e6f5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:17.577610 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb42ec85-2508-42c3-98ac-96a0ef88e6f5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:17.578058 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb42ec85-2508-42c3-98ac-96a0ef88e6f5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:17.578835 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb42ec85-2508-42c3-98ac-96a0ef88e6f5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:17.579268 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb42ec85-2508-42c3-98ac-96a0ef88e6f5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:17.637634 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.network.neutron [None req-27fb7ddf-0734-4cf2-8272-e3b4be7a114e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] validate_networks() for [('64dd4aa3-e414-467b-84ff-dc68d3d652e1', None, None, None, None, None)] {{(pid=122901) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 16:49:17.725819 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-fb42ec85-2508-42c3-98ac-96a0ef88e6f5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:17.736842 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-fb42ec85-2508-42c3-98ac-96a0ef88e6f5 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1573 microversion: 2.1 time: 0.169888 Feb 08 16:49:17.737427 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 513/1019] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:17 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1573 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:18.009330 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-27fb7ddf-0734-4cf2-8272-e3b4be7a114e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Flavor limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 16:49:18.009751 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-27fb7ddf-0734-4cf2-8272-e3b4be7a114e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Image limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 16:49:18.010217 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-27fb7ddf-0734-4cf2-8272-e3b4be7a114e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Flavor pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 16:49:18.010640 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-27fb7ddf-0734-4cf2-8272-e3b4be7a114e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Image pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 16:49:18.011105 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-27fb7ddf-0734-4cf2-8272-e3b4be7a114e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 16:49:18.020782 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-27fb7ddf-0734-4cf2-8272-e3b4be7a114e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:18.021227 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-27fb7ddf-0734-4cf2-8272-e3b4be7a114e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:18.022033 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-27fb7ddf-0734-4cf2-8272-e3b4be7a114e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:18.022465 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-27fb7ddf-0734-4cf2-8272-e3b4be7a114e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:18.038948 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-27fb7ddf-0734-4cf2-8272-e3b4be7a114e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Getting quotas for project 23325df6a88748fc9261e22c093ac67e. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:49:18.042779 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-27fb7ddf-0734-4cf2-8272-e3b4be7a114e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Getting quotas for user c858d129681846aba9e366c37c2213a0 and project 23325df6a88748fc9261e22c093ac67e. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:49:18.053510 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-27fb7ddf-0734-4cf2-8272-e3b4be7a114e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Going to run 1 instances... {{(pid=122901) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 16:49:18.055923 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-27fb7ddf-0734-4cf2-8272-e3b4be7a114e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d70d3911-14f2-4cba-9283-bf4bef4fb526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122901) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 16:49:18.100922 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-27fb7ddf-0734-4cf2-8272-e3b4be7a114e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.572397 Feb 08 16:49:18.101554 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 507/1020] 10.222.0.35 () {62 vars in 1187 bytes} [Tue Feb 8 16:49:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 08 16:49:18.111126 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-3661e16e-3a4e-4f52-80c7-384ec842452d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:18.111735 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-3661e16e-3a4e-4f52-80c7-384ec842452d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:18.166814 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3661e16e-3a4e-4f52-80c7-384ec842452d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:18.174532 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3661e16e-3a4e-4f52-80c7-384ec842452d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:18.175987 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3661e16e-3a4e-4f52-80c7-384ec842452d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:18.177083 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-3661e16e-3a4e-4f52-80c7-384ec842452d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1280 microversion: 2.20 time: 0.069613 Feb 08 16:49:18.177636 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 514/1021] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:49:18 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1280 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:49:18.754345 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-9bef8730-e135-4b91-9e57-ec24ccc7df23 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:18.754872 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-9bef8730-e135-4b91-9e57-ec24ccc7df23 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:18.761008 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9bef8730-e135-4b91-9e57-ec24ccc7df23 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:18.761452 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9bef8730-e135-4b91-9e57-ec24ccc7df23 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:18.762219 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9bef8730-e135-4b91-9e57-ec24ccc7df23 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:18.762648 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9bef8730-e135-4b91-9e57-ec24ccc7df23 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:18.901246 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-9bef8730-e135-4b91-9e57-ec24ccc7df23 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:18.908821 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-9bef8730-e135-4b91-9e57-ec24ccc7df23 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1573 microversion: 2.1 time: 0.159003 Feb 08 16:49:18.909406 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 508/1022] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:18 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:19.194011 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-88d592d7-2854-436b-be6c-148751a73672 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:19.194626 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-88d592d7-2854-436b-be6c-148751a73672 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:19.201578 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-88d592d7-2854-436b-be6c-148751a73672 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:19.202187 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-88d592d7-2854-436b-be6c-148751a73672 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:19.203023 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-88d592d7-2854-436b-be6c-148751a73672 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:19.203476 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-88d592d7-2854-436b-be6c-148751a73672 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:19.265384 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-88d592d7-2854-436b-be6c-148751a73672 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:19.273559 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-88d592d7-2854-436b-be6c-148751a73672 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:19.275044 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-88d592d7-2854-436b-be6c-148751a73672 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:19.276182 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-88d592d7-2854-436b-be6c-148751a73672 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1338 microversion: 2.20 time: 0.085783 Feb 08 16:49:19.276738 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 515/1023] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:49:19 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1338 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:49:19.925622 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-223b95e1-6ac2-4bd6-ad9f-c5b50d38b7b8 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:19.926336 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-223b95e1-6ac2-4bd6-ad9f-c5b50d38b7b8 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:19.933359 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-223b95e1-6ac2-4bd6-ad9f-c5b50d38b7b8 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:19.933999 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-223b95e1-6ac2-4bd6-ad9f-c5b50d38b7b8 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:19.935050 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-223b95e1-6ac2-4bd6-ad9f-c5b50d38b7b8 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:19.935904 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-223b95e1-6ac2-4bd6-ad9f-c5b50d38b7b8 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:20.172838 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-223b95e1-6ac2-4bd6-ad9f-c5b50d38b7b8 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:20.181151 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-223b95e1-6ac2-4bd6-ad9f-c5b50d38b7b8 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1573 microversion: 2.1 time: 0.259264 Feb 08 16:49:20.181733 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 509/1024] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:19 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1573 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:20.294385 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b93d8839-6d44-4a3f-82c3-47c258edda45 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:20.295381 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b93d8839-6d44-4a3f-82c3-47c258edda45 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:20.302168 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b93d8839-6d44-4a3f-82c3-47c258edda45 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:20.302721 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b93d8839-6d44-4a3f-82c3-47c258edda45 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:20.303597 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b93d8839-6d44-4a3f-82c3-47c258edda45 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:20.304139 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b93d8839-6d44-4a3f-82c3-47c258edda45 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:20.451263 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b93d8839-6d44-4a3f-82c3-47c258edda45 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:20.459349 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b93d8839-6d44-4a3f-82c3-47c258edda45 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:20.460880 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b93d8839-6d44-4a3f-82c3-47c258edda45 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:20.461991 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b93d8839-6d44-4a3f-82c3-47c258edda45 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1405 microversion: 2.20 time: 0.171444 Feb 08 16:49:20.462550 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 516/1025] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:49:20 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:49:20.485891 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-79dccf8e-fc3c-457c-8087-014df3207e1e req-40dc7432-163e-406b-805c-4400176b0cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a6041b-b9e3-4224-b52e-265ff88bb57e", "tag": "a1385bb4-6242-43a5-80b9-5e5963fd66f2"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:49:20.487826 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:49:20.487826 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:49:20.495746 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-79dccf8e-fc3c-457c-8087-014df3207e1e req-40dc7432-163e-406b-805c-4400176b0cdd service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:20.496638 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-79dccf8e-fc3c-457c-8087-014df3207e1e req-40dc7432-163e-406b-805c-4400176b0cdd service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:20.509461 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-79dccf8e-fc3c-457c-8087-014df3207e1e req-40dc7432-163e-406b-805c-4400176b0cdd service nova] Creating event network-changed:a1385bb4-6242-43a5-80b9-5e5963fd66f2 for instance 71a6041b-b9e3-4224-b52e-265ff88bb57e on hv-cinder-82786 Feb 08 16:49:20.515122 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-79dccf8e-fc3c-457c-8087-014df3207e1e req-40dc7432-163e-406b-805c-4400176b0cdd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033483 Feb 08 16:49:20.516281 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 510/1026] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:49:21.197730 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-2b015f95-832f-43fe-84d2-63a58bf1df16 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:21.198344 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-2b015f95-832f-43fe-84d2-63a58bf1df16 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:21.204274 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2b015f95-832f-43fe-84d2-63a58bf1df16 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:21.204737 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2b015f95-832f-43fe-84d2-63a58bf1df16 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:21.205525 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2b015f95-832f-43fe-84d2-63a58bf1df16 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:21.205962 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2b015f95-832f-43fe-84d2-63a58bf1df16 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:21.342869 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-2b015f95-832f-43fe-84d2-63a58bf1df16 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:21.350336 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-2b015f95-832f-43fe-84d2-63a58bf1df16 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1573 microversion: 2.1 time: 0.156363 Feb 08 16:49:21.350896 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 517/1027] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:21 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:21.481392 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-f2cac36b-f573-45b3-b249-2ce56a76c98c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:21.482334 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-f2cac36b-f573-45b3-b249-2ce56a76c98c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:21.488440 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f2cac36b-f573-45b3-b249-2ce56a76c98c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:21.488892 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f2cac36b-f573-45b3-b249-2ce56a76c98c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:21.489673 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f2cac36b-f573-45b3-b249-2ce56a76c98c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:21.490106 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f2cac36b-f573-45b3-b249-2ce56a76c98c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:21.625300 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f2cac36b-f573-45b3-b249-2ce56a76c98c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:21.632950 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f2cac36b-f573-45b3-b249-2ce56a76c98c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:21.634422 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f2cac36b-f573-45b3-b249-2ce56a76c98c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:21.635511 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-f2cac36b-f573-45b3-b249-2ce56a76c98c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1405 microversion: 2.20 time: 0.158625 Feb 08 16:49:21.636125 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 511/1028] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:49:21 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:49:22.367382 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c107fbe2-1eb4-4d80-b5c9-3b069f58c441 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:22.368045 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c107fbe2-1eb4-4d80-b5c9-3b069f58c441 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:22.374322 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c107fbe2-1eb4-4d80-b5c9-3b069f58c441 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:22.374771 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c107fbe2-1eb4-4d80-b5c9-3b069f58c441 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:22.375835 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c107fbe2-1eb4-4d80-b5c9-3b069f58c441 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:22.376271 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c107fbe2-1eb4-4d80-b5c9-3b069f58c441 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:22.507260 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c107fbe2-1eb4-4d80-b5c9-3b069f58c441 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:22.515082 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c107fbe2-1eb4-4d80-b5c9-3b069f58c441 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1573 microversion: 2.1 time: 0.151326 Feb 08 16:49:22.515635 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 518/1029] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:22 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:22.653354 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-abe7ca0a-6571-4077-a5f3-f3742391b149 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:22.654490 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-abe7ca0a-6571-4077-a5f3-f3742391b149 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:22.660969 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-abe7ca0a-6571-4077-a5f3-f3742391b149 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:22.661426 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-abe7ca0a-6571-4077-a5f3-f3742391b149 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:22.662210 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-abe7ca0a-6571-4077-a5f3-f3742391b149 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:22.662651 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-abe7ca0a-6571-4077-a5f3-f3742391b149 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:22.792015 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-abe7ca0a-6571-4077-a5f3-f3742391b149 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:22.800675 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-abe7ca0a-6571-4077-a5f3-f3742391b149 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:22.802223 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-abe7ca0a-6571-4077-a5f3-f3742391b149 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:22.803346 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-abe7ca0a-6571-4077-a5f3-f3742391b149 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1405 microversion: 2.20 time: 0.153770 Feb 08 16:49:22.803938 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 512/1030] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:49:22 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:49:23.531682 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c4395100-a42f-4964-a950-cbe5d9ff9d4e tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:23.532321 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c4395100-a42f-4964-a950-cbe5d9ff9d4e tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:23.538548 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c4395100-a42f-4964-a950-cbe5d9ff9d4e tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:23.538997 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c4395100-a42f-4964-a950-cbe5d9ff9d4e tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:23.539880 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c4395100-a42f-4964-a950-cbe5d9ff9d4e tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:23.540319 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c4395100-a42f-4964-a950-cbe5d9ff9d4e tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:23.680182 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c4395100-a42f-4964-a950-cbe5d9ff9d4e tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:23.689397 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c4395100-a42f-4964-a950-cbe5d9ff9d4e tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1573 microversion: 2.1 time: 0.161429 Feb 08 16:49:23.689987 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 519/1031] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:23 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:23.821225 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-351b956d-d1b4-42e0-a2ed-cb0235cdec04 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:23.821941 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-351b956d-d1b4-42e0-a2ed-cb0235cdec04 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:23.828586 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-351b956d-d1b4-42e0-a2ed-cb0235cdec04 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:23.829035 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-351b956d-d1b4-42e0-a2ed-cb0235cdec04 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:23.829823 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-351b956d-d1b4-42e0-a2ed-cb0235cdec04 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:23.830261 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-351b956d-d1b4-42e0-a2ed-cb0235cdec04 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:23.965953 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-351b956d-d1b4-42e0-a2ed-cb0235cdec04 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:23.974003 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-351b956d-d1b4-42e0-a2ed-cb0235cdec04 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:23.975495 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-351b956d-d1b4-42e0-a2ed-cb0235cdec04 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:23.976644 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-351b956d-d1b4-42e0-a2ed-cb0235cdec04 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1405 microversion: 2.20 time: 0.159169 Feb 08 16:49:23.977201 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 513/1032] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:49:23 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:49:24.707371 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b1827410-02df-4bce-aeae-af95b6102c80 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:24.707983 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b1827410-02df-4bce-aeae-af95b6102c80 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:24.713818 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b1827410-02df-4bce-aeae-af95b6102c80 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:24.714276 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b1827410-02df-4bce-aeae-af95b6102c80 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:24.715065 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b1827410-02df-4bce-aeae-af95b6102c80 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:24.715508 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b1827410-02df-4bce-aeae-af95b6102c80 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:24.851988 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b1827410-02df-4bce-aeae-af95b6102c80 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:24.859529 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b1827410-02df-4bce-aeae-af95b6102c80 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1573 microversion: 2.1 time: 0.156050 Feb 08 16:49:24.860292 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 520/1033] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:24 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:24.994218 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-bfd87516-22cf-4656-8b9e-9719780d99c7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:24.994946 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-bfd87516-22cf-4656-8b9e-9719780d99c7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:25.002080 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bfd87516-22cf-4656-8b9e-9719780d99c7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:25.003515 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bfd87516-22cf-4656-8b9e-9719780d99c7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:25.004342 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bfd87516-22cf-4656-8b9e-9719780d99c7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:25.004780 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bfd87516-22cf-4656-8b9e-9719780d99c7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:25.135552 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-bfd87516-22cf-4656-8b9e-9719780d99c7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:25.144070 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-bfd87516-22cf-4656-8b9e-9719780d99c7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:25.145729 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-bfd87516-22cf-4656-8b9e-9719780d99c7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:25.149340 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-bfd87516-22cf-4656-8b9e-9719780d99c7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1405 microversion: 2.20 time: 0.156318 Feb 08 16:49:25.149340 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 514/1034] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:49:24 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:49:25.276804 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-3769134b-5867-42dc-825f-6cb012aff26a req-bc3c76e4-8669-49f1-968c-2a963d9e1c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f5b0dab-9c28-4519-a6f6-c98d7c9a5287", "name": "network-vif-plugged", "status": "completed", "tag": "6f04fb2f-d81d-42f0-8c53-184ef0859a38"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:49:25.278455 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:49:25.278455 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:49:25.287589 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-3769134b-5867-42dc-825f-6cb012aff26a req-bc3c76e4-8669-49f1-968c-2a963d9e1c00 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:25.288381 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-3769134b-5867-42dc-825f-6cb012aff26a req-bc3c76e4-8669-49f1-968c-2a963d9e1c00 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:25.300277 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-3769134b-5867-42dc-825f-6cb012aff26a req-bc3c76e4-8669-49f1-968c-2a963d9e1c00 service nova] Creating event network-vif-plugged:6f04fb2f-d81d-42f0-8c53-184ef0859a38 for instance 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 on hv-cinder-82786 Feb 08 16:49:25.305213 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-3769134b-5867-42dc-825f-6cb012aff26a req-bc3c76e4-8669-49f1-968c-2a963d9e1c00 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032134 Feb 08 16:49:25.310003 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 521/1035] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:49:25.877753 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-3da0f03e-4731-4d24-a677-da648d06196b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:25.878356 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-3da0f03e-4731-4d24-a677-da648d06196b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:25.884273 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3da0f03e-4731-4d24-a677-da648d06196b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:25.884721 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3da0f03e-4731-4d24-a677-da648d06196b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:25.885490 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3da0f03e-4731-4d24-a677-da648d06196b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:25.885918 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3da0f03e-4731-4d24-a677-da648d06196b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:26.019545 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-3da0f03e-4731-4d24-a677-da648d06196b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:26.026845 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-3da0f03e-4731-4d24-a677-da648d06196b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1573 microversion: 2.1 time: 0.153089 Feb 08 16:49:26.027403 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 515/1036] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:25 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:26.165538 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-3893b9bc-eda1-4846-a2cc-ebe5cb6a5573 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:26.166172 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-3893b9bc-eda1-4846-a2cc-ebe5cb6a5573 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:26.173233 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3893b9bc-eda1-4846-a2cc-ebe5cb6a5573 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:26.173687 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3893b9bc-eda1-4846-a2cc-ebe5cb6a5573 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:26.174470 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3893b9bc-eda1-4846-a2cc-ebe5cb6a5573 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:26.174913 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3893b9bc-eda1-4846-a2cc-ebe5cb6a5573 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:26.305591 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3893b9bc-eda1-4846-a2cc-ebe5cb6a5573 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:26.314282 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3893b9bc-eda1-4846-a2cc-ebe5cb6a5573 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:26.315801 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3893b9bc-eda1-4846-a2cc-ebe5cb6a5573 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:26.316917 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-3893b9bc-eda1-4846-a2cc-ebe5cb6a5573 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1405 microversion: 2.20 time: 0.155551 Feb 08 16:49:26.317478 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 522/1037] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:49:26 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:49:27.042940 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-3985f373-8af2-4dab-adb1-eecb693a7e12 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:27.043562 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-3985f373-8af2-4dab-adb1-eecb693a7e12 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:27.050284 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3985f373-8af2-4dab-adb1-eecb693a7e12 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:27.050759 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3985f373-8af2-4dab-adb1-eecb693a7e12 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:27.051674 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3985f373-8af2-4dab-adb1-eecb693a7e12 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:27.052224 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3985f373-8af2-4dab-adb1-eecb693a7e12 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:27.204090 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-3985f373-8af2-4dab-adb1-eecb693a7e12 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:27.214624 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-3985f373-8af2-4dab-adb1-eecb693a7e12 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1573 microversion: 2.1 time: 0.174782 Feb 08 16:49:27.215204 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 516/1038] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:27 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1573 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:27.324104 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-2e3dc8e4-3af7-4d3d-8caf-474a517c0591 req-8c123c4e-6c49-49e9-bc5c-dc79bf100a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a6041b-b9e3-4224-b52e-265ff88bb57e", "name": "network-vif-plugged", "status": "completed", "tag": "a1385bb4-6242-43a5-80b9-5e5963fd66f2"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:49:27.325768 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:49:27.325768 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:49:27.333362 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-2e3dc8e4-3af7-4d3d-8caf-474a517c0591 req-8c123c4e-6c49-49e9-bc5c-dc79bf100a4f service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:27.333954 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-2e3dc8e4-3af7-4d3d-8caf-474a517c0591 req-8c123c4e-6c49-49e9-bc5c-dc79bf100a4f service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:27.334091 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b5b5e392-62e3-4d94-80b4-bf54c2472fce tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:27.334654 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-b5b5e392-62e3-4d94-80b4-bf54c2472fce tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:27.340492 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b5b5e392-62e3-4d94-80b4-bf54c2472fce tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:27.340944 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b5b5e392-62e3-4d94-80b4-bf54c2472fce tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:27.342257 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b5b5e392-62e3-4d94-80b4-bf54c2472fce tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:27.342692 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b5b5e392-62e3-4d94-80b4-bf54c2472fce tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:27.346193 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-2e3dc8e4-3af7-4d3d-8caf-474a517c0591 req-8c123c4e-6c49-49e9-bc5c-dc79bf100a4f service nova] Creating event network-vif-plugged:a1385bb4-6242-43a5-80b9-5e5963fd66f2 for instance 71a6041b-b9e3-4224-b52e-265ff88bb57e on hv-cinder-82786 Feb 08 16:49:27.352290 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-2e3dc8e4-3af7-4d3d-8caf-474a517c0591 req-8c123c4e-6c49-49e9-bc5c-dc79bf100a4f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031568 Feb 08 16:49:27.353150 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 523/1039] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:49:27.488043 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-b5b5e392-62e3-4d94-80b4-bf54c2472fce tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:27.495736 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-b5b5e392-62e3-4d94-80b4-bf54c2472fce tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:27.497365 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-b5b5e392-62e3-4d94-80b4-bf54c2472fce tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:27.498476 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-b5b5e392-62e3-4d94-80b4-bf54c2472fce tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1405 microversion: 2.20 time: 0.168103 Feb 08 16:49:27.499039 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 517/1040] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:49:27 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:49:28.232636 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b38096a8-0ea3-4a51-bb55-6b33adeca12b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:28.233389 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b38096a8-0ea3-4a51-bb55-6b33adeca12b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:28.239858 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b38096a8-0ea3-4a51-bb55-6b33adeca12b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:28.240521 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b38096a8-0ea3-4a51-bb55-6b33adeca12b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:28.241486 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b38096a8-0ea3-4a51-bb55-6b33adeca12b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:28.242037 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b38096a8-0ea3-4a51-bb55-6b33adeca12b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:28.383437 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-b38096a8-0ea3-4a51-bb55-6b33adeca12b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:28.391060 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b38096a8-0ea3-4a51-bb55-6b33adeca12b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1560 microversion: 2.1 time: 0.163009 Feb 08 16:49:28.391623 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 524/1041] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:28 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:28.516248 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d2b2fec0-22fe-4994-b03f-3af9a9fdec2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:28.516830 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-d2b2fec0-22fe-4994-b03f-3af9a9fdec2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:28.523100 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d2b2fec0-22fe-4994-b03f-3af9a9fdec2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:28.523545 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d2b2fec0-22fe-4994-b03f-3af9a9fdec2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:28.524364 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d2b2fec0-22fe-4994-b03f-3af9a9fdec2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:28.524797 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d2b2fec0-22fe-4994-b03f-3af9a9fdec2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:28.657854 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d2b2fec0-22fe-4994-b03f-3af9a9fdec2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:28.665442 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d2b2fec0-22fe-4994-b03f-3af9a9fdec2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:28.666915 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d2b2fec0-22fe-4994-b03f-3af9a9fdec2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:28.668028 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d2b2fec0-22fe-4994-b03f-3af9a9fdec2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1405 microversion: 2.20 time: 0.155415 Feb 08 16:49:28.668585 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 518/1042] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:49:28 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:49:29.686883 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-7707126e-5b6c-4ca1-8a17-13c12edf6634 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:29.687493 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-7707126e-5b6c-4ca1-8a17-13c12edf6634 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:29.693809 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7707126e-5b6c-4ca1-8a17-13c12edf6634 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:29.694265 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7707126e-5b6c-4ca1-8a17-13c12edf6634 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:29.695042 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7707126e-5b6c-4ca1-8a17-13c12edf6634 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:29.695483 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7707126e-5b6c-4ca1-8a17-13c12edf6634 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:29.825464 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-7707126e-5b6c-4ca1-8a17-13c12edf6634 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:29.833080 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-7707126e-5b6c-4ca1-8a17-13c12edf6634 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:29.834589 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-7707126e-5b6c-4ca1-8a17-13c12edf6634 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:29.835719 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-7707126e-5b6c-4ca1-8a17-13c12edf6634 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1597 microversion: 2.20 time: 0.153255 Feb 08 16:49:29.836299 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 525/1043] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:49:29 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1597 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:49:29.852463 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b528272a-f540-4817-92f8-d8bbb01cc307 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:29.852966 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-b528272a-f540-4817-92f8-d8bbb01cc307 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:29.859772 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b528272a-f540-4817-92f8-d8bbb01cc307 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:29.860237 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b528272a-f540-4817-92f8-d8bbb01cc307 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:29.861028 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b528272a-f540-4817-92f8-d8bbb01cc307 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:29.861470 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b528272a-f540-4817-92f8-d8bbb01cc307 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:29.942938 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-b528272a-f540-4817-92f8-d8bbb01cc307 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.094092 Feb 08 16:49:29.943539 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 519/1044] 10.222.0.35 () {60 vars in 1315 bytes} [Tue Feb 8 16:49:29 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:49:31.107638 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c41b3fae-b361-451b-b5fb-1a5b0edfbbe7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:31.108403 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c41b3fae-b361-451b-b5fb-1a5b0edfbbe7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:31.109977 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-e1666030-c14b-4121-a143-05f86ba0400a req-3e581e31-a30a-4381-b7a4-99baa12b7bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a6041b-b9e3-4224-b52e-265ff88bb57e", "tag": "a1385bb4-6242-43a5-80b9-5e5963fd66f2"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:49:31.111455 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:49:31.111455 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:49:31.114838 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c41b3fae-b361-451b-b5fb-1a5b0edfbbe7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:31.115525 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c41b3fae-b361-451b-b5fb-1a5b0edfbbe7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:31.116520 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c41b3fae-b361-451b-b5fb-1a5b0edfbbe7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:31.116962 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c41b3fae-b361-451b-b5fb-1a5b0edfbbe7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:31.118729 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-e1666030-c14b-4121-a143-05f86ba0400a req-3e581e31-a30a-4381-b7a4-99baa12b7bc1 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:31.119235 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-e1666030-c14b-4121-a143-05f86ba0400a req-3e581e31-a30a-4381-b7a4-99baa12b7bc1 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:31.131044 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-e1666030-c14b-4121-a143-05f86ba0400a req-3e581e31-a30a-4381-b7a4-99baa12b7bc1 service nova] Creating event network-changed:a1385bb4-6242-43a5-80b9-5e5963fd66f2 for instance 71a6041b-b9e3-4224-b52e-265ff88bb57e on hv-cinder-82786 Feb 08 16:49:31.136096 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-e1666030-c14b-4121-a143-05f86ba0400a req-3e581e31-a30a-4381-b7a4-99baa12b7bc1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030743 Feb 08 16:49:31.136703 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 520/1045] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:49:31.265127 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c41b3fae-b361-451b-b5fb-1a5b0edfbbe7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:31.274040 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c41b3fae-b361-451b-b5fb-1a5b0edfbbe7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:31.275536 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c41b3fae-b361-451b-b5fb-1a5b0edfbbe7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:31.276977 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c41b3fae-b361-451b-b5fb-1a5b0edfbbe7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1597 microversion: 2.20 time: 0.174276 Feb 08 16:49:31.277547 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 526/1046] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:49:31 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1597 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:49:32.167562 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-5c4d0ca4-def7-4c22-a335-857c3de34cb6 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:32.169278 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-5c4d0ca4-def7-4c22-a335-857c3de34cb6 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:32.176218 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5c4d0ca4-def7-4c22-a335-857c3de34cb6 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:32.176688 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5c4d0ca4-def7-4c22-a335-857c3de34cb6 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:32.177474 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5c4d0ca4-def7-4c22-a335-857c3de34cb6 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:32.178094 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5c4d0ca4-def7-4c22-a335-857c3de34cb6 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:32.206547 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-5c4d0ca4-def7-4c22-a335-857c3de34cb6 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043743 Feb 08 16:49:32.207099 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 521/1047] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:49:32 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 08 16:49:32.262456 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e114ee25-4758-428b-b3d2-5192e0847557 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:32.263498 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e114ee25-4758-428b-b3d2-5192e0847557 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:32.269933 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e114ee25-4758-428b-b3d2-5192e0847557 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:32.270393 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e114ee25-4758-428b-b3d2-5192e0847557 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:32.271226 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e114ee25-4758-428b-b3d2-5192e0847557 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:32.271669 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e114ee25-4758-428b-b3d2-5192e0847557 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:32.296547 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-01f3894f-8764-4a21-8c8f-5c06a7341011 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:32.296745 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e114ee25-4758-428b-b3d2-5192e0847557 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Going to try to terminate instance {{(pid=122902) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 16:49:32.297149 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-01f3894f-8764-4a21-8c8f-5c06a7341011 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:32.302828 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-01f3894f-8764-4a21-8c8f-5c06a7341011 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:32.303274 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-01f3894f-8764-4a21-8c8f-5c06a7341011 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:32.304084 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-01f3894f-8764-4a21-8c8f-5c06a7341011 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:32.304519 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-01f3894f-8764-4a21-8c8f-5c06a7341011 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:32.371363 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e114ee25-4758-428b-b3d2-5192e0847557 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "DELETE /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 204 len: 0 microversion: 2.1 time: 0.112203 Feb 08 16:49:32.372009 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 527/1048] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Feb 8 16:49:32 2022] DELETE /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 16:49:32.381270 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-2cedc88b-63fb-4c63-b7af-fb387ec213f2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:32.381980 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-2cedc88b-63fb-4c63-b7af-fb387ec213f2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:32.388644 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2cedc88b-63fb-4c63-b7af-fb387ec213f2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:32.389104 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2cedc88b-63fb-4c63-b7af-fb387ec213f2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:32.389907 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2cedc88b-63fb-4c63-b7af-fb387ec213f2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:32.390353 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2cedc88b-63fb-4c63-b7af-fb387ec213f2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:32.452309 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-01f3894f-8764-4a21-8c8f-5c06a7341011 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:32.460369 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-01f3894f-8764-4a21-8c8f-5c06a7341011 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:32.461873 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-01f3894f-8764-4a21-8c8f-5c06a7341011 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:32.463075 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-01f3894f-8764-4a21-8c8f-5c06a7341011 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1716 microversion: 2.20 time: 0.170129 Feb 08 16:49:32.463646 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 522/1049] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:49:32 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1716 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:49:32.480882 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-fe219a5d-9d88-4b4a-9f20-ed53fe554fa1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:32.481577 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-fe219a5d-9d88-4b4a-9f20-ed53fe554fa1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:32.488056 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fe219a5d-9d88-4b4a-9f20-ed53fe554fa1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:32.488501 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fe219a5d-9d88-4b4a-9f20-ed53fe554fa1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:32.489284 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fe219a5d-9d88-4b4a-9f20-ed53fe554fa1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:32.489715 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fe219a5d-9d88-4b4a-9f20-ed53fe554fa1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:32.513433 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-fe219a5d-9d88-4b4a-9f20-ed53fe554fa1 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e/ips" status: 200 len: 152 microversion: 2.20 time: 0.036052 Feb 08 16:49:32.514305 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 523/1050] 10.222.0.35 () {60 vars in 1288 bytes} [Tue Feb 8 16:49:32 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 08 16:49:32.531295 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-2cedc88b-63fb-4c63-b7af-fb387ec213f2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:32.538661 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-2cedc88b-63fb-4c63-b7af-fb387ec213f2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1674 microversion: 2.1 time: 0.161305 Feb 08 16:49:32.539231 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 528/1051] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:32 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:49:33.556249 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-06360bc7-2206-484a-ac32-3b441fb1482c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:33.556896 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-06360bc7-2206-484a-ac32-3b441fb1482c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:33.564289 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-06360bc7-2206-484a-ac32-3b441fb1482c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:33.564661 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-06360bc7-2206-484a-ac32-3b441fb1482c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:33.565467 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-06360bc7-2206-484a-ac32-3b441fb1482c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:33.565907 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-06360bc7-2206-484a-ac32-3b441fb1482c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:33.709093 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-06360bc7-2206-484a-ac32-3b441fb1482c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:33.717135 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-06360bc7-2206-484a-ac32-3b441fb1482c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1674 microversion: 2.1 time: 0.164333 Feb 08 16:49:33.717773 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 524/1052] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:33 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:34.591523 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-aecf14da-1f9a-44bb-99a0-daaa05401c61 req-7482e9e7-3a6a-46f9-9d0c-41f232d1580a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136b1df1-a111-4a7b-8a8d-5e095dadc764", "name": "network-vif-deleted", "tag": "f72c3bbd-5f67-4f43-a4c1-f7f6cc240f10"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:49:34.593202 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:49:34.593202 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:49:34.601066 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-aecf14da-1f9a-44bb-99a0-daaa05401c61 req-7482e9e7-3a6a-46f9-9d0c-41f232d1580a service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:34.601596 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-aecf14da-1f9a-44bb-99a0-daaa05401c61 req-7482e9e7-3a6a-46f9-9d0c-41f232d1580a service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:34.613585 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-aecf14da-1f9a-44bb-99a0-daaa05401c61 req-7482e9e7-3a6a-46f9-9d0c-41f232d1580a service nova] Creating event network-vif-deleted:f72c3bbd-5f67-4f43-a4c1-f7f6cc240f10 for instance 136b1df1-a111-4a7b-8a8d-5e095dadc764 on hv-cinder-82786 Feb 08 16:49:34.618724 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-aecf14da-1f9a-44bb-99a0-daaa05401c61 req-7482e9e7-3a6a-46f9-9d0c-41f232d1580a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031180 Feb 08 16:49:34.619596 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 529/1053] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:49:34.735087 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e5f7b1e9-9444-4aff-b5fd-72aa965c361f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:34.736029 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e5f7b1e9-9444-4aff-b5fd-72aa965c361f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:34.742752 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e5f7b1e9-9444-4aff-b5fd-72aa965c361f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:34.743338 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e5f7b1e9-9444-4aff-b5fd-72aa965c361f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:34.744260 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e5f7b1e9-9444-4aff-b5fd-72aa965c361f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:34.744817 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e5f7b1e9-9444-4aff-b5fd-72aa965c361f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:34.777382 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e5f7b1e9-9444-4aff-b5fd-72aa965c361f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:34.778002 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e5f7b1e9-9444-4aff-b5fd-72aa965c361f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:34.779276 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.objects.instance [None req-e5f7b1e9-9444-4aff-b5fd-72aa965c361f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lazy-loading 'fault' on Instance uuid 136b1df1-a111-4a7b-8a8d-5e095dadc764 {{(pid=122901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:49:34.821000 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e5f7b1e9-9444-4aff-b5fd-72aa965c361f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:34.829413 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e5f7b1e9-9444-4aff-b5fd-72aa965c361f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 200 len: 1327 microversion: 2.1 time: 0.099003 Feb 08 16:49:34.829985 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 525/1054] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:34 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:35.848880 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-bb2fc895-aa6b-4b6a-a678-1c0961e6d0d4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:35.849504 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-bb2fc895-aa6b-4b6a-a678-1c0961e6d0d4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:35.855577 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bb2fc895-aa6b-4b6a-a678-1c0961e6d0d4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:35.856066 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bb2fc895-aa6b-4b6a-a678-1c0961e6d0d4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:35.857016 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bb2fc895-aa6b-4b6a-a678-1c0961e6d0d4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:35.857463 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bb2fc895-aa6b-4b6a-a678-1c0961e6d0d4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:35.870419 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-bb2fc895-aa6b-4b6a-a678-1c0961e6d0d4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] HTTP exception thrown: Instance 136b1df1-a111-4a7b-8a8d-5e095dadc764 could not be found. Feb 08 16:49:35.870997 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-bb2fc895-aa6b-4b6a-a678-1c0961e6d0d4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Returning 404 to user: Instance 136b1df1-a111-4a7b-8a8d-5e095dadc764 could not be found. {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:49:35.871825 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-bb2fc895-aa6b-4b6a-a678-1c0961e6d0d4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 404 len: 111 microversion: 2.1 time: 0.027539 Feb 08 16:49:35.872432 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 530/1055] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:35 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:49:35.880694 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-8cb7edc9-8394-4547-8c6d-113b5e27e924 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '.version_select at 0x7fcde01ac9d0>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:35.898347 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-8cb7edc9-8394-4547-8c6d-113b5e27e924 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-701831441" status: 202 len: 0 microversion: 2.1 time: 0.021204 Feb 08 16:49:35.898902 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 526/1056] 10.222.0.35 () {58 vars in 1217 bytes} [Tue Feb 8 16:49:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-701831441 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:49:36.520142 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-782002d2-6f13-4872-a79f-8648ff120498 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Action: 'create', calling method: .version_select at 0x7fcde0211820>, body: {"keypair": {"name": "tempest-keypair-1496228144"}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:49:36.533847 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-782002d2-6f13-4872-a79f-8648ff120498 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Getting quotas for project 2214758b43e6434b8c27d97f7fd1151c. Resources: {'key_pairs'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:49:36.537622 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-782002d2-6f13-4872-a79f-8648ff120498 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Getting quotas for user c5f36415ea7148d79f9fdb9cfac129e0 and project 2214758b43e6434b8c27d97f7fd1151c. Resources: {'key_pairs'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:49:36.818446 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-782002d2-6f13-4872-a79f-8648ff120498 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Getting quotas for project 2214758b43e6434b8c27d97f7fd1151c. Resources: {'key_pairs'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:49:36.822144 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-782002d2-6f13-4872-a79f-8648ff120498 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Getting quotas for user c5f36415ea7148d79f9fdb9cfac129e0 and project 2214758b43e6434b8c27d97f7fd1151c. Resources: {'key_pairs'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:49:36.834957 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-782002d2-6f13-4872-a79f-8648ff120498 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.318576 Feb 08 16:49:36.835548 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 531/1057] 10.222.0.35 () {60 vars in 1157 bytes} [Tue Feb 8 16:49:36 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:38.063975 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-556df38e-2deb-4cf3-bfaa-befcb92f4106 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-81702805", "imageRef": "d70d3911-14f2-4cba-9283-bf4bef4fb526", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7ae536f5-aefa-4f5b-af4d-8517e1f813dd"}], "security_groups": [{"name": "tempest-securitygroup--929767528"}], "key_name": "tempest-keypair-1496228144", "user_data": "}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:49:38.161644 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.network.neutron [None req-556df38e-2deb-4cf3-bfaa-befcb92f4106 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] validate_networks() for [('7ae536f5-aefa-4f5b-af4d-8517e1f813dd', None, None, None, None, None)] {{(pid=122901) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 16:49:38.522523 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-556df38e-2deb-4cf3-bfaa-befcb92f4106 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Flavor limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 16:49:38.522950 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-556df38e-2deb-4cf3-bfaa-befcb92f4106 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Image limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 16:49:38.523416 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-556df38e-2deb-4cf3-bfaa-befcb92f4106 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Flavor pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 16:49:38.523862 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-556df38e-2deb-4cf3-bfaa-befcb92f4106 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Image pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 16:49:38.524280 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-556df38e-2deb-4cf3-bfaa-befcb92f4106 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 16:49:38.533068 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-556df38e-2deb-4cf3-bfaa-befcb92f4106 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:38.533517 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-556df38e-2deb-4cf3-bfaa-befcb92f4106 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:38.534330 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-556df38e-2deb-4cf3-bfaa-befcb92f4106 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:38.534765 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-556df38e-2deb-4cf3-bfaa-befcb92f4106 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:38.550604 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-556df38e-2deb-4cf3-bfaa-befcb92f4106 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Getting quotas for project 2214758b43e6434b8c27d97f7fd1151c. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:49:38.554449 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-556df38e-2deb-4cf3-bfaa-befcb92f4106 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Getting quotas for user c5f36415ea7148d79f9fdb9cfac129e0 and project 2214758b43e6434b8c27d97f7fd1151c. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:49:38.565531 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-556df38e-2deb-4cf3-bfaa-befcb92f4106 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Going to run 1 instances... {{(pid=122901) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 16:49:38.567805 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-556df38e-2deb-4cf3-bfaa-befcb92f4106 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d70d3911-14f2-4cba-9283-bf4bef4fb526',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122901) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 16:49:38.613121 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-556df38e-2deb-4cf3-bfaa-befcb92f4106 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.554419 Feb 08 16:49:38.613759 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 527/1058] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Feb 8 16:49:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 16:49:38.624537 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-d575ce5f-b571-424f-afd0-d999485de070 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:38.625437 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-d575ce5f-b571-424f-afd0-d999485de070 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:38.917092 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-d575ce5f-b571-424f-afd0-d999485de070 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:38.924093 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-d575ce5f-b571-424f-afd0-d999485de070 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b" status: 200 len: 1236 microversion: 2.1 time: 0.304340 Feb 08 16:49:38.924664 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 532/1059] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:38 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b => generated 1236 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:39.942768 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-bed2afc9-ab03-4c9d-868d-8682a3317e85 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:39.943364 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-bed2afc9-ab03-4c9d-868d-8682a3317e85 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:39.950305 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bed2afc9-ab03-4c9d-868d-8682a3317e85 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:39.950761 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bed2afc9-ab03-4c9d-868d-8682a3317e85 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:39.951647 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bed2afc9-ab03-4c9d-868d-8682a3317e85 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:39.952298 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bed2afc9-ab03-4c9d-868d-8682a3317e85 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:40.049365 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-bed2afc9-ab03-4c9d-868d-8682a3317e85 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:40.056566 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-bed2afc9-ab03-4c9d-868d-8682a3317e85 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b" status: 200 len: 1294 microversion: 2.1 time: 0.118757 Feb 08 16:49:40.057140 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 528/1060] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:39 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b => generated 1294 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:40.870008 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-ea01cdaa-197a-4482-b447-bab50a93c033 req-e777635a-e415-4086-869a-2f0ecb70c713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b69ba823-eca2-461c-849e-746060cb934b", "tag": "dc24f391-2e36-414a-9320-975414f69f4f"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:49:40.873821 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:49:40.873821 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:49:40.894862 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-ea01cdaa-197a-4482-b447-bab50a93c033 req-e777635a-e415-4086-869a-2f0ecb70c713 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:40.895346 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-ea01cdaa-197a-4482-b447-bab50a93c033 req-e777635a-e415-4086-869a-2f0ecb70c713 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:40.909361 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-ea01cdaa-197a-4482-b447-bab50a93c033 req-e777635a-e415-4086-869a-2f0ecb70c713 service nova] Creating event network-changed:dc24f391-2e36-414a-9320-975414f69f4f for instance b69ba823-eca2-461c-849e-746060cb934b on hv-cinder-82786 Feb 08 16:49:40.914384 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-ea01cdaa-197a-4482-b447-bab50a93c033 req-e777635a-e415-4086-869a-2f0ecb70c713 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051567 Feb 08 16:49:40.915365 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 533/1061] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:49:41.073245 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-9a8b5ef9-3122-4b19-ad0e-4900a33fd3eb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:41.074013 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-9a8b5ef9-3122-4b19-ad0e-4900a33fd3eb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:41.080567 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9a8b5ef9-3122-4b19-ad0e-4900a33fd3eb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:41.081056 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9a8b5ef9-3122-4b19-ad0e-4900a33fd3eb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:41.081850 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9a8b5ef9-3122-4b19-ad0e-4900a33fd3eb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:41.082295 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9a8b5ef9-3122-4b19-ad0e-4900a33fd3eb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:41.592027 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-9a8b5ef9-3122-4b19-ad0e-4900a33fd3eb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:41.599409 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-9a8b5ef9-3122-4b19-ad0e-4900a33fd3eb tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b" status: 200 len: 1361 microversion: 2.1 time: 0.529796 Feb 08 16:49:41.600162 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 529/1062] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:41 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b => generated 1361 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:42.617747 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e936dec1-7f88-47d5-878d-a15ee879ed91 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:42.618448 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e936dec1-7f88-47d5-878d-a15ee879ed91 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:42.625356 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e936dec1-7f88-47d5-878d-a15ee879ed91 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:42.625809 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e936dec1-7f88-47d5-878d-a15ee879ed91 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:42.627201 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e936dec1-7f88-47d5-878d-a15ee879ed91 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:42.627914 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e936dec1-7f88-47d5-878d-a15ee879ed91 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:42.772227 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e936dec1-7f88-47d5-878d-a15ee879ed91 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:42.780955 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e936dec1-7f88-47d5-878d-a15ee879ed91 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b" status: 200 len: 1361 microversion: 2.1 time: 0.167160 Feb 08 16:49:42.781531 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 534/1063] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:42 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:43.798281 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-572b25e9-b20c-4b51-9da0-ace1ba9aa014 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:43.799381 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-572b25e9-b20c-4b51-9da0-ace1ba9aa014 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:43.805794 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-572b25e9-b20c-4b51-9da0-ace1ba9aa014 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:43.806245 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-572b25e9-b20c-4b51-9da0-ace1ba9aa014 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:43.807027 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-572b25e9-b20c-4b51-9da0-ace1ba9aa014 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:43.807466 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-572b25e9-b20c-4b51-9da0-ace1ba9aa014 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:43.943006 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-572b25e9-b20c-4b51-9da0-ace1ba9aa014 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:43.950250 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-572b25e9-b20c-4b51-9da0-ace1ba9aa014 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b" status: 200 len: 1361 microversion: 2.1 time: 0.155723 Feb 08 16:49:43.951314 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 530/1064] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:43 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:44.966435 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-4d2c489b-6b74-4ecc-91bd-ba5a8f8740d1 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:44.967043 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-4d2c489b-6b74-4ecc-91bd-ba5a8f8740d1 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:44.974231 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4d2c489b-6b74-4ecc-91bd-ba5a8f8740d1 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:44.974680 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4d2c489b-6b74-4ecc-91bd-ba5a8f8740d1 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:44.975450 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4d2c489b-6b74-4ecc-91bd-ba5a8f8740d1 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:44.975914 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-4d2c489b-6b74-4ecc-91bd-ba5a8f8740d1 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:45.110500 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-4d2c489b-6b74-4ecc-91bd-ba5a8f8740d1 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:45.117210 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-4d2c489b-6b74-4ecc-91bd-ba5a8f8740d1 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b" status: 200 len: 1361 microversion: 2.1 time: 0.154479 Feb 08 16:49:45.124992 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 535/1065] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:44 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:46.134441 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e95f0315-84ed-4314-8659-33fa62d35b67 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:46.135026 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e95f0315-84ed-4314-8659-33fa62d35b67 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:46.142213 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e95f0315-84ed-4314-8659-33fa62d35b67 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:46.142601 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e95f0315-84ed-4314-8659-33fa62d35b67 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:46.143427 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e95f0315-84ed-4314-8659-33fa62d35b67 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:46.144116 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e95f0315-84ed-4314-8659-33fa62d35b67 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:46.278430 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-e95f0315-84ed-4314-8659-33fa62d35b67 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:46.285702 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e95f0315-84ed-4314-8659-33fa62d35b67 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b" status: 200 len: 1361 microversion: 2.1 time: 0.154962 Feb 08 16:49:46.286271 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 531/1066] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:46 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:49:47.224247 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-c6c0df73-b383-44fd-bcd7-36b26c44cb4b req-dafb6aba-402a-40b0-b7bd-e2c92118eea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69ba823-eca2-461c-849e-746060cb934b", "name": "network-vif-plugged", "status": "completed", "tag": "dc24f391-2e36-414a-9320-975414f69f4f"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:49:47.225773 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:49:47.225773 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:49:47.233741 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-c6c0df73-b383-44fd-bcd7-36b26c44cb4b req-dafb6aba-402a-40b0-b7bd-e2c92118eea5 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:47.234485 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-c6c0df73-b383-44fd-bcd7-36b26c44cb4b req-dafb6aba-402a-40b0-b7bd-e2c92118eea5 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:47.246937 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-c6c0df73-b383-44fd-bcd7-36b26c44cb4b req-dafb6aba-402a-40b0-b7bd-e2c92118eea5 service nova] Creating event network-vif-plugged:dc24f391-2e36-414a-9320-975414f69f4f for instance b69ba823-eca2-461c-849e-746060cb934b on hv-cinder-82786 Feb 08 16:49:47.252760 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-c6c0df73-b383-44fd-bcd7-36b26c44cb4b req-dafb6aba-402a-40b0-b7bd-e2c92118eea5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032208 Feb 08 16:49:47.253344 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 536/1067] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:49:47.302437 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-4185f307-ae1d-4480-9876-8896bc656165 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:47.303130 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4185f307-ae1d-4480-9876-8896bc656165 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:47.309680 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4185f307-ae1d-4480-9876-8896bc656165 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:47.310124 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4185f307-ae1d-4480-9876-8896bc656165 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:47.310908 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4185f307-ae1d-4480-9876-8896bc656165 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:47.311391 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4185f307-ae1d-4480-9876-8896bc656165 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:47.480147 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4185f307-ae1d-4480-9876-8896bc656165 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:47.487644 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-4185f307-ae1d-4480-9876-8896bc656165 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b" status: 200 len: 1361 microversion: 2.1 time: 0.188895 Feb 08 16:49:47.488233 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 532/1068] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:47 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:48.506189 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c6ce73b1-9e13-462c-a87b-de1ade8a5a4c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:48.506804 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c6ce73b1-9e13-462c-a87b-de1ade8a5a4c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:48.512939 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c6ce73b1-9e13-462c-a87b-de1ade8a5a4c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:48.513395 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c6ce73b1-9e13-462c-a87b-de1ade8a5a4c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:48.514168 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c6ce73b1-9e13-462c-a87b-de1ade8a5a4c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:48.514608 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c6ce73b1-9e13-462c-a87b-de1ade8a5a4c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:48.646188 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c6ce73b1-9e13-462c-a87b-de1ade8a5a4c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:48.653383 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c6ce73b1-9e13-462c-a87b-de1ade8a5a4c tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b" status: 200 len: 1361 microversion: 2.1 time: 0.151735 Feb 08 16:49:48.653951 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 537/1069] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:48 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:49.670353 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-c238dd47-c529-4021-8783-6f396d5f6b2b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:49.670878 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-c238dd47-c529-4021-8783-6f396d5f6b2b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:49.677513 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c238dd47-c529-4021-8783-6f396d5f6b2b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:49.678044 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c238dd47-c529-4021-8783-6f396d5f6b2b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:49.678764 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c238dd47-c529-4021-8783-6f396d5f6b2b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:49.679195 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c238dd47-c529-4021-8783-6f396d5f6b2b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:49.808419 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c238dd47-c529-4021-8783-6f396d5f6b2b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:49.815710 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-c238dd47-c529-4021-8783-6f396d5f6b2b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b" status: 200 len: 1547 microversion: 2.1 time: 0.149333 Feb 08 16:49:49.816293 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 533/1070] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:49 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:49.831252 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-72d28360-0d55-4535-b78a-a8408df2c089 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:49.831736 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-72d28360-0d55-4535-b78a-a8408df2c089 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:49.838037 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-72d28360-0d55-4535-b78a-a8408df2c089 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:49.838494 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-72d28360-0d55-4535-b78a-a8408df2c089 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:49.839276 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-72d28360-0d55-4535-b78a-a8408df2c089 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:49.839723 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-72d28360-0d55-4535-b78a-a8408df2c089 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:49.921875 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-72d28360-0d55-4535-b78a-a8408df2c089 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094049 Feb 08 16:49:49.922431 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 538/1071] 10.222.0.35 () {58 vars in 1274 bytes} [Tue Feb 8 16:49:49 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:49:50.863430 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-cd72c643-05be-404d-bfd0-0410aec13c5b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:50.864656 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-cd72c643-05be-404d-bfd0-0410aec13c5b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:50.866869 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-e936dc1a-13ff-42ca-8406-12c73b110df5 req-64c601fe-45b2-4cbd-b8e0-4846bb0f0808 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b69ba823-eca2-461c-849e-746060cb934b", "tag": "dc24f391-2e36-414a-9320-975414f69f4f"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:49:50.868697 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:49:50.868697 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:49:50.870999 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cd72c643-05be-404d-bfd0-0410aec13c5b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:50.871447 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cd72c643-05be-404d-bfd0-0410aec13c5b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:50.872280 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cd72c643-05be-404d-bfd0-0410aec13c5b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:50.872715 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cd72c643-05be-404d-bfd0-0410aec13c5b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:50.876597 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-e936dc1a-13ff-42ca-8406-12c73b110df5 req-64c601fe-45b2-4cbd-b8e0-4846bb0f0808 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:50.877157 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-e936dc1a-13ff-42ca-8406-12c73b110df5 req-64c601fe-45b2-4cbd-b8e0-4846bb0f0808 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:50.889296 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-e936dc1a-13ff-42ca-8406-12c73b110df5 req-64c601fe-45b2-4cbd-b8e0-4846bb0f0808 service nova] Creating event network-changed:dc24f391-2e36-414a-9320-975414f69f4f for instance b69ba823-eca2-461c-849e-746060cb934b on hv-cinder-82786 Feb 08 16:49:50.894942 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-e936dc1a-13ff-42ca-8406-12c73b110df5 req-64c601fe-45b2-4cbd-b8e0-4846bb0f0808 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032998 Feb 08 16:49:50.895684 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 539/1072] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:49:51.104012 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-cd72c643-05be-404d-bfd0-0410aec13c5b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:51.111811 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-cd72c643-05be-404d-bfd0-0410aec13c5b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b" status: 200 len: 1547 microversion: 2.1 time: 0.252315 Feb 08 16:49:51.112390 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 534/1073] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:50 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b => generated 1547 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:52.130206 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-ad865e60-e989-4dff-86b3-fbd4c581e7c2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:52.130919 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-ad865e60-e989-4dff-86b3-fbd4c581e7c2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:52.137174 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ad865e60-e989-4dff-86b3-fbd4c581e7c2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:52.137635 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ad865e60-e989-4dff-86b3-fbd4c581e7c2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:52.138465 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ad865e60-e989-4dff-86b3-fbd4c581e7c2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:52.138993 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ad865e60-e989-4dff-86b3-fbd4c581e7c2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:52.275959 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ad865e60-e989-4dff-86b3-fbd4c581e7c2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:49:52.284665 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-ad865e60-e989-4dff-86b3-fbd4c581e7c2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b" status: 200 len: 1666 microversion: 2.1 time: 0.159092 Feb 08 16:49:52.285232 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 540/1074] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:49:52 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b => generated 1666 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:49:52.301435 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-5396a46a-bea1-4dd9-897a-0fb32029e7c2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:49:52.301959 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-5396a46a-bea1-4dd9-897a-0fb32029e7c2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:52.308539 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5396a46a-bea1-4dd9-897a-0fb32029e7c2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:52.308990 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5396a46a-bea1-4dd9-897a-0fb32029e7c2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:52.309770 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5396a46a-bea1-4dd9-897a-0fb32029e7c2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:52.310201 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5396a46a-bea1-4dd9-897a-0fb32029e7c2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:52.333674 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-5396a46a-bea1-4dd9-897a-0fb32029e7c2 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/ips" status: 200 len: 146 microversion: 2.1 time: 0.035860 Feb 08 16:49:52.334265 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 535/1075] 10.222.0.35 () {58 vars in 1247 bytes} [Tue Feb 8 16:49:52 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:49:53.638445 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-6809decc-1315-4868-8079-d411a764e864 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf7a889e-8621-4a1e-b367-4e593f885b3f"}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:49:53.639489 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-6809decc-1315-4868-8079-d411a764e864 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:49:53.646388 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6809decc-1315-4868-8079-d411a764e864 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:53.646848 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6809decc-1315-4868-8079-d411a764e864 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:53.647620 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6809decc-1315-4868-8079-d411a764e864 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:49:53.648087 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6809decc-1315-4868-8079-d411a764e864 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:49:53.877536 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-6809decc-1315-4868-8079-d411a764e864 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "POST /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.242655 Feb 08 16:49:53.878178 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 541/1076] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Feb 8 16:49:53 2022] POST /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-volume_attachments => generated 194 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:50:01.354626 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-e8642372-3027-4eee-8cf0-332fdf852ad3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:50:01.355590 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-e8642372-3027-4eee-8cf0-332fdf852ad3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:50:01.361792 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e8642372-3027-4eee-8cf0-332fdf852ad3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:01.362238 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e8642372-3027-4eee-8cf0-332fdf852ad3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:01.363005 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e8642372-3027-4eee-8cf0-332fdf852ad3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:01.363438 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-e8642372-3027-4eee-8cf0-332fdf852ad3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:01.393241 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-e8642372-3027-4eee-8cf0-332fdf852ad3 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042284 Feb 08 16:50:01.393802 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 536/1077] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:50:01 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:50:01.405438 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-eb5de80d-3367-4eb6-a5e8-8ce6f1a7cc3d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:50:01.406026 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-eb5de80d-3367-4eb6-a5e8-8ce6f1a7cc3d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:50:01.412339 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eb5de80d-3367-4eb6-a5e8-8ce6f1a7cc3d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:01.412794 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eb5de80d-3367-4eb6-a5e8-8ce6f1a7cc3d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:01.413596 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eb5de80d-3367-4eb6-a5e8-8ce6f1a7cc3d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:01.414037 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eb5de80d-3367-4eb6-a5e8-8ce6f1a7cc3d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:01.452210 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-eb5de80d-3367-4eb6-a5e8-8ce6f1a7cc3d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-volume_attachments/cf7a889e-8621-4a1e-b367-4e593f885b3f" status: 200 len: 194 microversion: 2.1 time: 0.051317 Feb 08 16:50:01.452793 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 542/1078] 10.222.0.35 () {58 vars in 1412 bytes} [Tue Feb 8 16:50:01 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-volume_attachments/cf7a889e-8621-4a1e-b367-4e593f885b3f => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:50:02.748340 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-18c9026e-45f3-4879-9516-2c1b76af78dc tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "786aa985-d10d-48c1-a43a-188b9c11254e"}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:50:02.749635 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-18c9026e-45f3-4879-9516-2c1b76af78dc tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:50:02.755951 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-18c9026e-45f3-4879-9516-2c1b76af78dc tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:02.756395 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-18c9026e-45f3-4879-9516-2c1b76af78dc tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:02.757162 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-18c9026e-45f3-4879-9516-2c1b76af78dc tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:02.757589 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-18c9026e-45f3-4879-9516-2c1b76af78dc tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:02.990578 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-18c9026e-45f3-4879-9516-2c1b76af78dc tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "POST /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245725 Feb 08 16:50:02.991220 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 537/1079] 10.222.0.35 () {60 vars in 1322 bytes} [Tue Feb 8 16:50:02 2022] POST /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:50:10.457320 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c6a437ca-dba3-491e-bf2f-c5e2a1dd033a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:50:10.458312 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c6a437ca-dba3-491e-bf2f-c5e2a1dd033a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:50:10.464636 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c6a437ca-dba3-491e-bf2f-c5e2a1dd033a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:10.465082 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c6a437ca-dba3-491e-bf2f-c5e2a1dd033a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:10.465852 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c6a437ca-dba3-491e-bf2f-c5e2a1dd033a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:10.466283 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c6a437ca-dba3-491e-bf2f-c5e2a1dd033a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:10.495044 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c6a437ca-dba3-491e-bf2f-c5e2a1dd033a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041521 Feb 08 16:50:10.495595 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 543/1080] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:50:10 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:50:12.648881 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-4347f35e-c5f5-4e38-9030-dc40c0a339cd tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1756152615"}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:50:12.649451 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4347f35e-c5f5-4e38-9030-dc40c0a339cd tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:50:12.655402 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4347f35e-c5f5-4e38-9030-dc40c0a339cd tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:12.655881 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4347f35e-c5f5-4e38-9030-dc40c0a339cd tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:12.656656 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4347f35e-c5f5-4e38-9030-dc40c0a339cd tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:12.657085 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4347f35e-c5f5-4e38-9030-dc40c0a339cd tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:12.789620 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.network.security_group_api [None req-4347f35e-c5f5-4e38-9030-dc40c0a339cd tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Removing security group 9e910800-aedc-4562-ad89-cc5596917dbc from port ef3eb329-986b-442c-9350-fab47f0d2892 Feb 08 16:50:13.124008 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-4347f35e-c5f5-4e38-9030-dc40c0a339cd tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "POST /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3/action" status: 202 len: 0 microversion: 2.1 time: 0.480267 Feb 08 16:50:13.124889 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 538/1081] 10.222.0.35 () {60 vars in 1277 bytes} [Tue Feb 8 16:50:12 2022] POST /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 08 16:50:13.141141 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-c53cfc6a-94db-4366-8f90-bda917c8f820 req-a304713d-07b1-48e8-8427-aadcd54e98d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b3f77f-d45a-4763-8843-929d858a24a3", "tag": "ef3eb329-986b-442c-9350-fab47f0d2892"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:50:13.143452 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:50:13.143452 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:50:13.153423 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-c53cfc6a-94db-4366-8f90-bda917c8f820 req-a304713d-07b1-48e8-8427-aadcd54e98d2 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:13.154287 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-c53cfc6a-94db-4366-8f90-bda917c8f820 req-a304713d-07b1-48e8-8427-aadcd54e98d2 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:13.168721 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-c53cfc6a-94db-4366-8f90-bda917c8f820 req-a304713d-07b1-48e8-8427-aadcd54e98d2 service nova] Creating event network-changed:ef3eb329-986b-442c-9350-fab47f0d2892 for instance 20b3f77f-d45a-4763-8843-929d858a24a3 on hv-cinder-82786 Feb 08 16:50:13.178404 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-c53cfc6a-94db-4366-8f90-bda917c8f820 req-a304713d-07b1-48e8-8427-aadcd54e98d2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040861 Feb 08 16:50:13.179553 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 544/1082] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:50:14.237544 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-4bff7bb2-2adb-4e04-9cbf-49a759491641 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:50:14.238064 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4bff7bb2-2adb-4e04-9cbf-49a759491641 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:50:14.240172 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-0642a29e-7f63-47b4-a924-ab1362d2cb75 req-8e0d234e-6bd7-4fae-9ef8-6ce4271e0279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20b3f77f-d45a-4763-8843-929d858a24a3", "tag": "ef3eb329-986b-442c-9350-fab47f0d2892"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:50:14.242220 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:50:14.242220 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:50:14.244843 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4bff7bb2-2adb-4e04-9cbf-49a759491641 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:14.245488 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4bff7bb2-2adb-4e04-9cbf-49a759491641 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:14.246280 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4bff7bb2-2adb-4e04-9cbf-49a759491641 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:14.246889 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4bff7bb2-2adb-4e04-9cbf-49a759491641 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:14.250573 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-0642a29e-7f63-47b4-a924-ab1362d2cb75 req-8e0d234e-6bd7-4fae-9ef8-6ce4271e0279 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:14.251140 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-0642a29e-7f63-47b4-a924-ab1362d2cb75 req-8e0d234e-6bd7-4fae-9ef8-6ce4271e0279 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:14.262613 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-0642a29e-7f63-47b4-a924-ab1362d2cb75 req-8e0d234e-6bd7-4fae-9ef8-6ce4271e0279 service nova] Creating event network-changed:ef3eb329-986b-442c-9350-fab47f0d2892 for instance 20b3f77f-d45a-4763-8843-929d858a24a3 on hv-cinder-82786 Feb 08 16:50:14.267820 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-0642a29e-7f63-47b4-a924-ab1362d2cb75 req-8e0d234e-6bd7-4fae-9ef8-6ce4271e0279 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031704 Feb 08 16:50:14.268808 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 545/1083] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:50:14.329812 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.objects.instance [None req-4bff7bb2-2adb-4e04-9cbf-49a759491641 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lazy-loading 'services' on Instance uuid 20b3f77f-d45a-4763-8843-929d858a24a3 {{(pid=122901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:50:14.406754 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-4bff7bb2-2adb-4e04-9cbf-49a759491641 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "DELETE /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3/os-volume_attachments/88ccf384-a333-41c5-be44-751a7d1549f4" status: 202 len: 0 microversion: 2.1 time: 0.173213 Feb 08 16:50:14.407653 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 539/1084] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Feb 8 16:50:14 2022] DELETE /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3/os-volume_attachments/88ccf384-a333-41c5-be44-751a7d1549f4 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:50:14.416421 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-73cfac10-fade-44f3-bc14-f7ae4e080c4e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:50:14.417435 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-73cfac10-fade-44f3-bc14-f7ae4e080c4e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:50:14.425266 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-73cfac10-fade-44f3-bc14-f7ae4e080c4e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:14.425887 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-73cfac10-fade-44f3-bc14-f7ae4e080c4e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:14.427054 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-73cfac10-fade-44f3-bc14-f7ae4e080c4e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:14.427816 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-73cfac10-fade-44f3-bc14-f7ae4e080c4e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:14.467015 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-73cfac10-fade-44f3-bc14-f7ae4e080c4e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054618 Feb 08 16:50:14.468058 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 546/1085] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:50:14 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:50:15.479664 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-0cff11a6-7522-4fa3-a717-a60abc272e6c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:50:15.480693 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-0cff11a6-7522-4fa3-a717-a60abc272e6c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:50:15.486799 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0cff11a6-7522-4fa3-a717-a60abc272e6c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:15.487261 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0cff11a6-7522-4fa3-a717-a60abc272e6c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:15.488072 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0cff11a6-7522-4fa3-a717-a60abc272e6c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:15.488513 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0cff11a6-7522-4fa3-a717-a60abc272e6c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:15.517106 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-0cff11a6-7522-4fa3-a717-a60abc272e6c tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042279 Feb 08 16:50:15.517657 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 540/1086] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:50:15 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 08 16:50:15.527776 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-0108d07d-8697-4297-8fee-a046ad29bff3 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:50:15.528339 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-0108d07d-8697-4297-8fee-a046ad29bff3 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:50:15.534637 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0108d07d-8697-4297-8fee-a046ad29bff3 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:15.535091 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0108d07d-8697-4297-8fee-a046ad29bff3 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:15.535903 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0108d07d-8697-4297-8fee-a046ad29bff3 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:15.536351 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0108d07d-8697-4297-8fee-a046ad29bff3 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:15.617215 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-0108d07d-8697-4297-8fee-a046ad29bff3 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] HTTP exception thrown: Instance 20b3f77f-d45a-4763-8843-929d858a24a3 is not attached to volume 88ccf384-a333-41c5-be44-751a7d1549f4 Feb 08 16:50:15.617818 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-0108d07d-8697-4297-8fee-a046ad29bff3 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Returning 404 to user: Instance 20b3f77f-d45a-4763-8843-929d858a24a3 is not attached to volume 88ccf384-a333-41c5-be44-751a7d1549f4 {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:50:15.618658 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-0108d07d-8697-4297-8fee-a046ad29bff3 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "DELETE /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3/os-volume_attachments/88ccf384-a333-41c5-be44-751a7d1549f4" status: 404 len: 154 microversion: 2.1 time: 0.094677 Feb 08 16:50:15.619207 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 547/1087] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Feb 8 16:50:15 2022] DELETE /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3/os-volume_attachments/88ccf384-a333-41c5-be44-751a7d1549f4 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:50:16.750279 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-0eb61dbf-1cdc-4104-a423-4987492431a7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:50:16.750803 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-0eb61dbf-1cdc-4104-a423-4987492431a7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:50:16.757860 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0eb61dbf-1cdc-4104-a423-4987492431a7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:16.758318 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0eb61dbf-1cdc-4104-a423-4987492431a7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:16.759159 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0eb61dbf-1cdc-4104-a423-4987492431a7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:16.759848 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0eb61dbf-1cdc-4104-a423-4987492431a7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:16.785379 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-0eb61dbf-1cdc-4104-a423-4987492431a7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Going to try to terminate instance {{(pid=122901) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 16:50:16.871050 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-0eb61dbf-1cdc-4104-a423-4987492431a7 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "DELETE /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 204 len: 0 microversion: 2.1 time: 0.124426 Feb 08 16:50:16.871648 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 541/1088] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Feb 8 16:50:16 2022] DELETE /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 16:50:16.879697 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-1d1d449a-6a76-4031-b7e2-6d6507f89772 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:50:16.880337 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-1d1d449a-6a76-4031-b7e2-6d6507f89772 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:50:16.887727 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1d1d449a-6a76-4031-b7e2-6d6507f89772 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:16.888213 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1d1d449a-6a76-4031-b7e2-6d6507f89772 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:16.889464 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1d1d449a-6a76-4031-b7e2-6d6507f89772 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:16.890015 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1d1d449a-6a76-4031-b7e2-6d6507f89772 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:17.028434 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-1d1d449a-6a76-4031-b7e2-6d6507f89772 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:17.035746 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-1d1d449a-6a76-4031-b7e2-6d6507f89772 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1555 microversion: 2.1 time: 0.159590 Feb 08 16:50:17.036325 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 548/1089] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:50:16 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:50:18.053321 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-879c0b4e-915f-4ab8-876a-984ee8452b2a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:50:18.054199 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-879c0b4e-915f-4ab8-876a-984ee8452b2a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:50:18.060683 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-879c0b4e-915f-4ab8-876a-984ee8452b2a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:18.061143 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-879c0b4e-915f-4ab8-876a-984ee8452b2a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:18.061937 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-879c0b4e-915f-4ab8-876a-984ee8452b2a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:18.062379 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-879c0b4e-915f-4ab8-876a-984ee8452b2a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:18.198036 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-879c0b4e-915f-4ab8-876a-984ee8452b2a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:18.205286 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-879c0b4e-915f-4ab8-876a-984ee8452b2a tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1555 microversion: 2.1 time: 0.156021 Feb 08 16:50:18.205845 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 542/1090] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:50:18 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:50:19.221820 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-6342390e-7b41-4dce-bc85-4873e1bf7245 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:50:19.222464 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-6342390e-7b41-4dce-bc85-4873e1bf7245 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:50:19.229511 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6342390e-7b41-4dce-bc85-4873e1bf7245 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:19.229965 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6342390e-7b41-4dce-bc85-4873e1bf7245 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:19.230754 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6342390e-7b41-4dce-bc85-4873e1bf7245 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:19.231193 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6342390e-7b41-4dce-bc85-4873e1bf7245 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:19.363737 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-6342390e-7b41-4dce-bc85-4873e1bf7245 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8d57b4da614728a52f90e2d7e6ed84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cd968a946ad4d3d9281c64f94d2eb09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:19.371328 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-6342390e-7b41-4dce-bc85-4873e1bf7245 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 200 len: 1555 microversion: 2.1 time: 0.153189 Feb 08 16:50:19.371918 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 549/1091] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:50:19 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:50:19.575798 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-95803e81-300c-4a23-8f83-4d9cf821204d req-0f379638-6a3e-406e-984b-2d3c82c53922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20b3f77f-d45a-4763-8843-929d858a24a3", "name": "network-vif-deleted", "tag": "ef3eb329-986b-442c-9350-fab47f0d2892"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:50:19.578061 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:50:19.578061 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:50:19.586452 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-95803e81-300c-4a23-8f83-4d9cf821204d req-0f379638-6a3e-406e-984b-2d3c82c53922 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:19.587200 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-95803e81-300c-4a23-8f83-4d9cf821204d req-0f379638-6a3e-406e-984b-2d3c82c53922 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:19.599573 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-95803e81-300c-4a23-8f83-4d9cf821204d req-0f379638-6a3e-406e-984b-2d3c82c53922 service nova] Creating event network-vif-deleted:ef3eb329-986b-442c-9350-fab47f0d2892 for instance 20b3f77f-d45a-4763-8843-929d858a24a3 on hv-cinder-82786 Feb 08 16:50:19.605856 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-95803e81-300c-4a23-8f83-4d9cf821204d req-0f379638-6a3e-406e-984b-2d3c82c53922 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033650 Feb 08 16:50:19.606429 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 543/1092] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:50:20.388781 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-45670f24-56c5-4c1a-81a6-1f62d642298e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:50:20.389376 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-45670f24-56c5-4c1a-81a6-1f62d642298e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] [instance: 20b3f77f-d45a-4763-8843-929d858a24a3] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:50:20.395657 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-45670f24-56c5-4c1a-81a6-1f62d642298e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:20.396147 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-45670f24-56c5-4c1a-81a6-1f62d642298e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:20.397024 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-45670f24-56c5-4c1a-81a6-1f62d642298e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:20.397627 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-45670f24-56c5-4c1a-81a6-1f62d642298e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:20.410740 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-45670f24-56c5-4c1a-81a6-1f62d642298e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] HTTP exception thrown: Instance 20b3f77f-d45a-4763-8843-929d858a24a3 could not be found. Feb 08 16:50:20.411333 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-45670f24-56c5-4c1a-81a6-1f62d642298e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Returning 404 to user: Instance 20b3f77f-d45a-4763-8843-929d858a24a3 could not be found. {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:50:20.412250 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-45670f24-56c5-4c1a-81a6-1f62d642298e tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3" status: 404 len: 111 microversion: 2.1 time: 0.027760 Feb 08 16:50:20.412786 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 550/1093] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:50:20 2022] GET /compute/v2.1/servers/20b3f77f-d45a-4763-8843-929d858a24a3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:50:20.421448 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b28a1d87-cc30-41a0-b94c-7e1f10731226 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] Calling method '.version_select at 0x7fcde05089d0>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:50:20.438301 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-b28a1d87-cc30-41a0-b94c-7e1f10731226 tempest-TestMinimumBasicScenario-1149647091 tempest-TestMinimumBasicScenario-1149647091-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2141805341" status: 202 len: 0 microversion: 2.1 time: 0.020893 Feb 08 16:50:20.438844 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 544/1094] 10.222.0.35 () {58 vars in 1271 bytes} [Tue Feb 8 16:50:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2141805341 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:50:38.198320 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b509482c-ef1b-42d0-915e-84fc1a181bb4 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Action: 'create', calling method: .version_select at 0x7fcde00dc1f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1759950308"}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:50:38.212471 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-b509482c-ef1b-42d0-915e-84fc1a181bb4 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Getting quotas for project 9a449e431c5240b897d5cab55009fdbf. Resources: {'key_pairs'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:50:38.216196 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-b509482c-ef1b-42d0-915e-84fc1a181bb4 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Getting quotas for user cd913a6397564f859fa9f1dd1edd4596 and project 9a449e431c5240b897d5cab55009fdbf. Resources: {'key_pairs'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:50:38.426313 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-b509482c-ef1b-42d0-915e-84fc1a181bb4 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Getting quotas for project 9a449e431c5240b897d5cab55009fdbf. Resources: {'key_pairs'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:50:38.430562 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-b509482c-ef1b-42d0-915e-84fc1a181bb4 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Getting quotas for user cd913a6397564f859fa9f1dd1edd4596 and project 9a449e431c5240b897d5cab55009fdbf. Resources: {'key_pairs'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:50:38.444241 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b509482c-ef1b-42d0-915e-84fc1a181bb4 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.422588 Feb 08 16:50:38.444845 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 551/1095] 10.222.0.35 () {60 vars in 1157 bytes} [Tue Feb 8 16:50:38 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:50:50.478029 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b8c59417-a5c0-4767-9946-c6e165674565 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:50:50.478682 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-b8c59417-a5c0-4767-9946-c6e165674565 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:50:50.484868 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b8c59417-a5c0-4767-9946-c6e165674565 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:50.485326 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b8c59417-a5c0-4767-9946-c6e165674565 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:50.486109 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b8c59417-a5c0-4767-9946-c6e165674565 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:50.486551 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b8c59417-a5c0-4767-9946-c6e165674565 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:50.509344 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.objects.instance [None req-b8c59417-a5c0-4767-9946-c6e165674565 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lazy-loading 'flavor' on Instance uuid 71a6041b-b9e3-4224-b52e-265ff88bb57e {{(pid=122901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:50:50.759474 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-b8c59417-a5c0-4767-9946-c6e165674565 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "POST /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e/action" status: 202 len: 0 microversion: 2.20 time: 0.285599 Feb 08 16:50:50.760259 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 545/1096] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Feb 8 16:50:50 2022] POST /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 08 16:50:50.768115 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-39f2138b-74c4-4b7d-bb62-e54efe918389 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:50:50.768726 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-39f2138b-74c4-4b7d-bb62-e54efe918389 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:50:50.777566 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-39f2138b-74c4-4b7d-bb62-e54efe918389 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:50.778009 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-39f2138b-74c4-4b7d-bb62-e54efe918389 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:50.778793 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-39f2138b-74c4-4b7d-bb62-e54efe918389 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:50.779257 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-39f2138b-74c4-4b7d-bb62-e54efe918389 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:50.915517 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-39f2138b-74c4-4b7d-bb62-e54efe918389 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:50.924128 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-39f2138b-74c4-4b7d-bb62-e54efe918389 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:50.925666 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-39f2138b-74c4-4b7d-bb62-e54efe918389 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:50.926830 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-39f2138b-74c4-4b7d-bb62-e54efe918389 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1722 microversion: 2.20 time: 0.162446 Feb 08 16:50:50.927403 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 552/1097] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:50:50 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:50:51.946931 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-3ed64e8e-e90a-440d-8cd1-95a3c8889a92 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:50:51.947928 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-3ed64e8e-e90a-440d-8cd1-95a3c8889a92 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:50:51.954107 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3ed64e8e-e90a-440d-8cd1-95a3c8889a92 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:51.954556 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3ed64e8e-e90a-440d-8cd1-95a3c8889a92 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:51.955335 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3ed64e8e-e90a-440d-8cd1-95a3c8889a92 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:51.955791 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3ed64e8e-e90a-440d-8cd1-95a3c8889a92 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:52.095134 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-3ed64e8e-e90a-440d-8cd1-95a3c8889a92 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:52.103173 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-3ed64e8e-e90a-440d-8cd1-95a3c8889a92 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:52.105273 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-3ed64e8e-e90a-440d-8cd1-95a3c8889a92 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:52.106469 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-3ed64e8e-e90a-440d-8cd1-95a3c8889a92 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1722 microversion: 2.20 time: 0.164093 Feb 08 16:50:52.107029 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 546/1098] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:50:51 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:50:53.125017 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-68337c8c-a7e5-4926-8507-3f4030e5647a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:50:53.125631 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-68337c8c-a7e5-4926-8507-3f4030e5647a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:50:53.131928 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-68337c8c-a7e5-4926-8507-3f4030e5647a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:53.132383 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-68337c8c-a7e5-4926-8507-3f4030e5647a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:53.133167 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-68337c8c-a7e5-4926-8507-3f4030e5647a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:53.133607 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-68337c8c-a7e5-4926-8507-3f4030e5647a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:53.268466 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-68337c8c-a7e5-4926-8507-3f4030e5647a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:53.276170 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-68337c8c-a7e5-4926-8507-3f4030e5647a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:53.278207 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-68337c8c-a7e5-4926-8507-3f4030e5647a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:53.279366 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-68337c8c-a7e5-4926-8507-3f4030e5647a tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1722 microversion: 2.20 time: 0.158323 Feb 08 16:50:53.279945 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 553/1099] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:50:53 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:50:54.297767 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-5b065856-82cb-43ff-b377-57e01a85b961 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:50:54.298368 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-5b065856-82cb-43ff-b377-57e01a85b961 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:50:54.304725 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5b065856-82cb-43ff-b377-57e01a85b961 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:54.305176 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5b065856-82cb-43ff-b377-57e01a85b961 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:54.305943 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5b065856-82cb-43ff-b377-57e01a85b961 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:54.306374 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5b065856-82cb-43ff-b377-57e01a85b961 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:54.439285 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-5b065856-82cb-43ff-b377-57e01a85b961 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:54.446983 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-5b065856-82cb-43ff-b377-57e01a85b961 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:54.448511 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-5b065856-82cb-43ff-b377-57e01a85b961 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:54.449674 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-5b065856-82cb-43ff-b377-57e01a85b961 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1722 microversion: 2.20 time: 0.156300 Feb 08 16:50:54.450232 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 547/1100] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:50:54 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:50:55.467739 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-38433c79-8b3a-4cc0-bae4-3c67b7314951 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:50:55.468377 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-38433c79-8b3a-4cc0-bae4-3c67b7314951 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:50:55.474622 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-38433c79-8b3a-4cc0-bae4-3c67b7314951 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:55.475080 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-38433c79-8b3a-4cc0-bae4-3c67b7314951 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:55.475898 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-38433c79-8b3a-4cc0-bae4-3c67b7314951 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:55.476336 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-38433c79-8b3a-4cc0-bae4-3c67b7314951 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:55.609576 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-38433c79-8b3a-4cc0-bae4-3c67b7314951 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:55.617390 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-38433c79-8b3a-4cc0-bae4-3c67b7314951 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:55.618890 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-38433c79-8b3a-4cc0-bae4-3c67b7314951 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:55.620081 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-38433c79-8b3a-4cc0-bae4-3c67b7314951 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1722 microversion: 2.20 time: 0.156322 Feb 08 16:50:55.620652 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 554/1101] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:50:55 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:50:56.639331 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-bd099a7d-5193-4b92-a266-46357159dca3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:50:56.639963 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-bd099a7d-5193-4b92-a266-46357159dca3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:50:56.646125 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bd099a7d-5193-4b92-a266-46357159dca3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:56.646570 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bd099a7d-5193-4b92-a266-46357159dca3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:56.647374 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bd099a7d-5193-4b92-a266-46357159dca3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:56.647833 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bd099a7d-5193-4b92-a266-46357159dca3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:56.777490 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-bd099a7d-5193-4b92-a266-46357159dca3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:56.785388 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-bd099a7d-5193-4b92-a266-46357159dca3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:56.786898 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-bd099a7d-5193-4b92-a266-46357159dca3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:56.788095 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-bd099a7d-5193-4b92-a266-46357159dca3 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1722 microversion: 2.20 time: 0.153052 Feb 08 16:50:56.788664 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 548/1102] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:50:56 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:50:57.805994 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-15d0c59a-3395-4c28-bd57-26885bce48d0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:50:57.806611 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-15d0c59a-3395-4c28-bd57-26885bce48d0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:50:57.813237 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-15d0c59a-3395-4c28-bd57-26885bce48d0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:57.813699 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-15d0c59a-3395-4c28-bd57-26885bce48d0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:57.814481 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-15d0c59a-3395-4c28-bd57-26885bce48d0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:57.814927 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-15d0c59a-3395-4c28-bd57-26885bce48d0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:57.952458 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-15d0c59a-3395-4c28-bd57-26885bce48d0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:57.960191 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-15d0c59a-3395-4c28-bd57-26885bce48d0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:57.961696 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-15d0c59a-3395-4c28-bd57-26885bce48d0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:57.962857 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-15d0c59a-3395-4c28-bd57-26885bce48d0 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1722 microversion: 2.20 time: 0.160600 Feb 08 16:50:57.963419 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 555/1103] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:50:57 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:50:58.981875 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-0b31c64b-14cb-4aef-8d77-2ee8338cecef tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:50:58.982787 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-0b31c64b-14cb-4aef-8d77-2ee8338cecef tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:50:58.989369 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0b31c64b-14cb-4aef-8d77-2ee8338cecef tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:58.989811 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0b31c64b-14cb-4aef-8d77-2ee8338cecef tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:58.990617 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0b31c64b-14cb-4aef-8d77-2ee8338cecef tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:50:58.991049 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0b31c64b-14cb-4aef-8d77-2ee8338cecef tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:50:59.152046 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0b31c64b-14cb-4aef-8d77-2ee8338cecef tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:59.162483 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0b31c64b-14cb-4aef-8d77-2ee8338cecef tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:59.164022 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0b31c64b-14cb-4aef-8d77-2ee8338cecef tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:50:59.165342 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-0b31c64b-14cb-4aef-8d77-2ee8338cecef tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1722 microversion: 2.20 time: 0.187363 Feb 08 16:50:59.165910 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 549/1104] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:50:58 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:00.188802 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-adc609f5-eb36-4dca-9c95-ea7fc5f50719 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:00.189421 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-adc609f5-eb36-4dca-9c95-ea7fc5f50719 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:00.195765 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-adc609f5-eb36-4dca-9c95-ea7fc5f50719 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:00.196248 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-adc609f5-eb36-4dca-9c95-ea7fc5f50719 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:00.197036 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-adc609f5-eb36-4dca-9c95-ea7fc5f50719 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:00.197478 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-adc609f5-eb36-4dca-9c95-ea7fc5f50719 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:00.329647 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-adc609f5-eb36-4dca-9c95-ea7fc5f50719 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:00.337354 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-adc609f5-eb36-4dca-9c95-ea7fc5f50719 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:00.338859 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-adc609f5-eb36-4dca-9c95-ea7fc5f50719 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:00.340052 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-adc609f5-eb36-4dca-9c95-ea7fc5f50719 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1722 microversion: 2.20 time: 0.155086 Feb 08 16:51:00.340612 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 556/1105] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:00 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:01.359009 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-93e35467-cbce-48de-bce9-1a5676304538 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:01.359611 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-93e35467-cbce-48de-bce9-1a5676304538 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:01.365845 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-93e35467-cbce-48de-bce9-1a5676304538 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:01.366289 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-93e35467-cbce-48de-bce9-1a5676304538 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:01.367055 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-93e35467-cbce-48de-bce9-1a5676304538 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:01.367485 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-93e35467-cbce-48de-bce9-1a5676304538 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:01.504957 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-93e35467-cbce-48de-bce9-1a5676304538 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:01.512734 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-93e35467-cbce-48de-bce9-1a5676304538 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:01.514754 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-93e35467-cbce-48de-bce9-1a5676304538 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:01.515938 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-93e35467-cbce-48de-bce9-1a5676304538 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1722 microversion: 2.20 time: 0.161427 Feb 08 16:51:01.516493 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 550/1106] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:01 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:01.940847 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-1aef03a7-5d3a-45b4-ac17-946932979c47 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1176954905", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1759950308", "security_groups": [{"name": "tempest-secgroup-smoke-1984801726"}], "block_device_mapping_v2": [{"uuid": "0d787bc8-5474-4a1d-9ccf-9c93837bb892", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d9762a02-45ed-4a30-9de3-b53831035fee"}]}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:51:02.051421 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.network.neutron [None req-1aef03a7-5d3a-45b4-ac17-946932979c47 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] validate_networks() for [('d9762a02-45ed-4a30-9de3-b53831035fee', None, None, None, None, None)] {{(pid=122902) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 16:51:02.502561 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-1aef03a7-5d3a-45b4-ac17-946932979c47 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Flavor limits 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 16:51:02.502987 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-1aef03a7-5d3a-45b4-ac17-946932979c47 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Image limits 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 16:51:02.503483 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-1aef03a7-5d3a-45b4-ac17-946932979c47 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Flavor pref 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 16:51:02.503934 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-1aef03a7-5d3a-45b4-ac17-946932979c47 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Image pref 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 16:51:02.504351 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-1aef03a7-5d3a-45b4-ac17-946932979c47 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 16:51:02.513380 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1aef03a7-5d3a-45b4-ac17-946932979c47 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:02.514007 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1aef03a7-5d3a-45b4-ac17-946932979c47 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:02.514822 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1aef03a7-5d3a-45b4-ac17-946932979c47 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:02.515261 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-1aef03a7-5d3a-45b4-ac17-946932979c47 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:02.532733 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-1aef03a7-5d3a-45b4-ac17-946932979c47 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Getting quotas for project 9a449e431c5240b897d5cab55009fdbf. Resources: {'cores', 'ram', 'instances'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:51:02.537030 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-1aef03a7-5d3a-45b4-ac17-946932979c47 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Getting quotas for user cd913a6397564f859fa9f1dd1edd4596 and project 9a449e431c5240b897d5cab55009fdbf. Resources: {'cores', 'ram', 'instances'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:51:02.538667 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-907aeb80-9bee-4a4b-af6f-4f9b816446de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:02.539276 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-907aeb80-9bee-4a4b-af6f-4f9b816446de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:02.546020 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-907aeb80-9bee-4a4b-af6f-4f9b816446de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:02.546477 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-907aeb80-9bee-4a4b-af6f-4f9b816446de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:02.547264 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-907aeb80-9bee-4a4b-af6f-4f9b816446de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:02.547701 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-907aeb80-9bee-4a4b-af6f-4f9b816446de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:02.594135 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-1aef03a7-5d3a-45b4-ac17-946932979c47 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Going to run 1 instances... {{(pid=122902) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 16:51:02.596646 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-1aef03a7-5d3a-45b4-ac17-946932979c47 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0d787bc8-5474-4a1d-9ccf-9c93837bb892',volume_size=None,volume_type=None)] {{(pid=122902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 16:51:02.691163 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-907aeb80-9bee-4a4b-af6f-4f9b816446de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:02.699205 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-907aeb80-9bee-4a4b-af6f-4f9b816446de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:02.701585 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-907aeb80-9bee-4a4b-af6f-4f9b816446de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:02.702980 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-907aeb80-9bee-4a4b-af6f-4f9b816446de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1743 microversion: 2.20 time: 0.167985 Feb 08 16:51:02.703608 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 551/1107] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:02 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:02.721933 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1aef03a7-5d3a-45b4-ac17-946932979c47 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [f2c2ee4f-df2e-4c54-8828-a50b32ea41bc] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 08 16:51:03.722382 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d33dd7c9-d414-4a42-949e-9d664611da3d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:03.722989 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-d33dd7c9-d414-4a42-949e-9d664611da3d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:03.729647 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO oslo.messaging._drivers.impl_rabbit [None req-1aef03a7-5d3a-45b4-ac17-946932979c47 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [f2c2ee4f-df2e-4c54-8828-a50b32ea41bc] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 50376. Feb 08 16:51:03.734804 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d33dd7c9-d414-4a42-949e-9d664611da3d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:03.735561 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-1aef03a7-5d3a-45b4-ac17-946932979c47 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.798054 Feb 08 16:51:03.735700 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d33dd7c9-d414-4a42-949e-9d664611da3d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:03.735834 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 557/1108] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Feb 8 16:51:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 16:51:03.736408 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d33dd7c9-d414-4a42-949e-9d664611da3d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:03.736951 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d33dd7c9-d414-4a42-949e-9d664611da3d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:03.746013 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-9cce7cfd-8cab-4d58-bc3b-7e498a9a2257 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:03.746680 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-9cce7cfd-8cab-4d58-bc3b-7e498a9a2257 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:03.819149 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9cce7cfd-8cab-4d58-bc3b-7e498a9a2257 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:03.827864 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-9cce7cfd-8cab-4d58-bc3b-7e498a9a2257 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 200 len: 1095 microversion: 2.1 time: 0.085930 Feb 08 16:51:03.828454 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 558/1109] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:03 2022] GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 1095 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:51:03.900007 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d33dd7c9-d414-4a42-949e-9d664611da3d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:03.908981 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d33dd7c9-d414-4a42-949e-9d664611da3d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:03.910468 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d33dd7c9-d414-4a42-949e-9d664611da3d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:03.911845 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d33dd7c9-d414-4a42-949e-9d664611da3d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1743 microversion: 2.20 time: 0.193103 Feb 08 16:51:03.912383 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 552/1110] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:03 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1743 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:51:04.844543 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-66eb29a5-774e-49ed-bcb8-648ccb1f63b7 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:04.845158 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-66eb29a5-774e-49ed-bcb8-648ccb1f63b7 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:04.851217 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-66eb29a5-774e-49ed-bcb8-648ccb1f63b7 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:04.851673 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-66eb29a5-774e-49ed-bcb8-648ccb1f63b7 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:04.852499 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-66eb29a5-774e-49ed-bcb8-648ccb1f63b7 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:04.852940 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-66eb29a5-774e-49ed-bcb8-648ccb1f63b7 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:04.930315 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d4a2be4f-86a9-4c9f-b52f-91ac09cbfb78 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:04.930931 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-d4a2be4f-86a9-4c9f-b52f-91ac09cbfb78 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:04.932722 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-66eb29a5-774e-49ed-bcb8-648ccb1f63b7 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:04.937498 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d4a2be4f-86a9-4c9f-b52f-91ac09cbfb78 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:04.937947 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d4a2be4f-86a9-4c9f-b52f-91ac09cbfb78 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:04.938732 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d4a2be4f-86a9-4c9f-b52f-91ac09cbfb78 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:04.939353 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d4a2be4f-86a9-4c9f-b52f-91ac09cbfb78 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:04.941410 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-66eb29a5-774e-49ed-bcb8-648ccb1f63b7 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 200 len: 1211 microversion: 2.1 time: 0.100598 Feb 08 16:51:04.941982 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 559/1111] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:04 2022] GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:51:05.306998 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d4a2be4f-86a9-4c9f-b52f-91ac09cbfb78 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:05.315675 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d4a2be4f-86a9-4c9f-b52f-91ac09cbfb78 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:05.317200 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d4a2be4f-86a9-4c9f-b52f-91ac09cbfb78 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:05.318409 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d4a2be4f-86a9-4c9f-b52f-91ac09cbfb78 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1743 microversion: 2.20 time: 0.391826 Feb 08 16:51:05.318983 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 553/1112] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:04 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1743 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:51:05.619450 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-49387f3d-184a-4260-a90e-c136724d4a33 req-f7b8b132-06a4-4d97-a2c8-8ad4f5c27c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a6041b-b9e3-4224-b52e-265ff88bb57e", "name": "network-vif-plugged", "status": "completed", "tag": "a1385bb4-6242-43a5-80b9-5e5963fd66f2"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:51:05.621277 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:51:05.621277 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:51:05.630829 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-49387f3d-184a-4260-a90e-c136724d4a33 req-f7b8b132-06a4-4d97-a2c8-8ad4f5c27c44 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:05.631503 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-49387f3d-184a-4260-a90e-c136724d4a33 req-f7b8b132-06a4-4d97-a2c8-8ad4f5c27c44 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:05.646183 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-49387f3d-184a-4260-a90e-c136724d4a33 req-f7b8b132-06a4-4d97-a2c8-8ad4f5c27c44 service nova] Creating event network-vif-plugged:a1385bb4-6242-43a5-80b9-5e5963fd66f2 for instance 71a6041b-b9e3-4224-b52e-265ff88bb57e on hv-cinder-82786 Feb 08 16:51:05.652659 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-49387f3d-184a-4260-a90e-c136724d4a33 req-f7b8b132-06a4-4d97-a2c8-8ad4f5c27c44 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037256 Feb 08 16:51:05.654869 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 560/1113] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:51:05.958540 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-9e71db96-c816-4f99-82dd-64c0e3df6cc4 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:05.959278 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-9e71db96-c816-4f99-82dd-64c0e3df6cc4 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:05.965625 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9e71db96-c816-4f99-82dd-64c0e3df6cc4 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:05.966085 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9e71db96-c816-4f99-82dd-64c0e3df6cc4 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:05.966884 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9e71db96-c816-4f99-82dd-64c0e3df6cc4 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:05.967331 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9e71db96-c816-4f99-82dd-64c0e3df6cc4 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:06.043339 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-9e71db96-c816-4f99-82dd-64c0e3df6cc4 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:06.051300 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-9e71db96-c816-4f99-82dd-64c0e3df6cc4 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 200 len: 1199 microversion: 2.1 time: 0.096415 Feb 08 16:51:06.052240 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 554/1114] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:05 2022] GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 1199 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:51:06.337918 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-396eb403-6f76-4e3b-a203-30c5fc592803 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:06.338608 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-396eb403-6f76-4e3b-a203-30c5fc592803 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:06.345383 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-396eb403-6f76-4e3b-a203-30c5fc592803 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:06.345827 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-396eb403-6f76-4e3b-a203-30c5fc592803 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:06.346643 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-396eb403-6f76-4e3b-a203-30c5fc592803 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:06.347073 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-396eb403-6f76-4e3b-a203-30c5fc592803 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:06.496258 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-396eb403-6f76-4e3b-a203-30c5fc592803 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:06.505676 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-396eb403-6f76-4e3b-a203-30c5fc592803 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:06.508217 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-396eb403-6f76-4e3b-a203-30c5fc592803 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:06.509418 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-396eb403-6f76-4e3b-a203-30c5fc592803 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1743 microversion: 2.20 time: 0.175662 Feb 08 16:51:06.509989 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 561/1115] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:06 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:51:06.602965 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-17de81c6-1eab-4de5-8f28-c271c35d469c req-25512276-79dc-4196-b946-25a02f8b3a59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f5b0dab-9c28-4519-a6f6-c98d7c9a5287", "tag": "6f04fb2f-d81d-42f0-8c53-184ef0859a38"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:51:06.604512 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:51:06.604512 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:51:06.608650 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-87f1e4ea-a460-406a-939e-3eee9ea734f6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:06.609373 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-87f1e4ea-a460-406a-939e-3eee9ea734f6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:06.611850 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-17de81c6-1eab-4de5-8f28-c271c35d469c req-25512276-79dc-4196-b946-25a02f8b3a59 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:06.612649 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-17de81c6-1eab-4de5-8f28-c271c35d469c req-25512276-79dc-4196-b946-25a02f8b3a59 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:06.615362 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-87f1e4ea-a460-406a-939e-3eee9ea734f6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:06.615835 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-87f1e4ea-a460-406a-939e-3eee9ea734f6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:06.616892 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-87f1e4ea-a460-406a-939e-3eee9ea734f6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:06.617556 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-87f1e4ea-a460-406a-939e-3eee9ea734f6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:06.628164 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-17de81c6-1eab-4de5-8f28-c271c35d469c req-25512276-79dc-4196-b946-25a02f8b3a59 service nova] Creating event network-changed:6f04fb2f-d81d-42f0-8c53-184ef0859a38 for instance 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 on hv-cinder-82786 Feb 08 16:51:06.633771 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-17de81c6-1eab-4de5-8f28-c271c35d469c req-25512276-79dc-4196-b946-25a02f8b3a59 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034384 Feb 08 16:51:06.634975 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 562/1116] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:51:06.644673 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-87f1e4ea-a460-406a-939e-3eee9ea734f6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Going to try to terminate instance {{(pid=122901) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 16:51:06.737279 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-87f1e4ea-a460-406a-939e-3eee9ea734f6 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "DELETE /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 204 len: 0 microversion: 2.1 time: 0.141282 Feb 08 16:51:06.738990 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 555/1117] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Feb 8 16:51:06 2022] DELETE /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 16:51:06.749515 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c7f2e943-8754-46df-b64c-b054c10720f4 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:06.750228 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c7f2e943-8754-46df-b64c-b054c10720f4 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:06.756685 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c7f2e943-8754-46df-b64c-b054c10720f4 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:06.757142 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c7f2e943-8754-46df-b64c-b054c10720f4 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:06.757937 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c7f2e943-8754-46df-b64c-b054c10720f4 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:06.758568 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c7f2e943-8754-46df-b64c-b054c10720f4 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:07.029724 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c7f2e943-8754-46df-b64c-b054c10720f4 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:07.039398 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c7f2e943-8754-46df-b64c-b054c10720f4 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1566 microversion: 2.1 time: 0.296102 Feb 08 16:51:07.042784 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 563/1118] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:06 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1566 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:51:07.068598 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ae48c896-0f6f-4033-915d-0fc02faeb147 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:07.069308 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-ae48c896-0f6f-4033-915d-0fc02faeb147 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:07.077183 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ae48c896-0f6f-4033-915d-0fc02faeb147 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:07.078395 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ae48c896-0f6f-4033-915d-0fc02faeb147 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:07.079693 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ae48c896-0f6f-4033-915d-0fc02faeb147 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:07.080691 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ae48c896-0f6f-4033-915d-0fc02faeb147 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:07.404158 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ae48c896-0f6f-4033-915d-0fc02faeb147 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:07.412005 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-ae48c896-0f6f-4033-915d-0fc02faeb147 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 200 len: 1267 microversion: 2.1 time: 0.347264 Feb 08 16:51:07.423166 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 556/1119] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:07 2022] GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 1267 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:51:07.528817 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-09be13ea-c72f-4f26-b284-4cc585ee7418 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:07.530233 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-09be13ea-c72f-4f26-b284-4cc585ee7418 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:07.537460 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-09be13ea-c72f-4f26-b284-4cc585ee7418 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:07.537914 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-09be13ea-c72f-4f26-b284-4cc585ee7418 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:07.538724 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-09be13ea-c72f-4f26-b284-4cc585ee7418 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:07.539170 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-09be13ea-c72f-4f26-b284-4cc585ee7418 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:07.688715 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-09be13ea-c72f-4f26-b284-4cc585ee7418 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:07.697303 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-09be13ea-c72f-4f26-b284-4cc585ee7418 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:07.698833 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-09be13ea-c72f-4f26-b284-4cc585ee7418 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:07.700047 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-09be13ea-c72f-4f26-b284-4cc585ee7418 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1743 microversion: 2.20 time: 0.175238 Feb 08 16:51:07.700661 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 564/1120] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:07 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:08.058513 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ddd19593-c2cf-4eab-b6ba-8cb2dd62e3fa tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:08.059126 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-ddd19593-c2cf-4eab-b6ba-8cb2dd62e3fa tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:08.065074 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ddd19593-c2cf-4eab-b6ba-8cb2dd62e3fa tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:08.065522 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ddd19593-c2cf-4eab-b6ba-8cb2dd62e3fa tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:08.066297 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ddd19593-c2cf-4eab-b6ba-8cb2dd62e3fa tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:08.066731 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ddd19593-c2cf-4eab-b6ba-8cb2dd62e3fa tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:08.213510 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ddd19593-c2cf-4eab-b6ba-8cb2dd62e3fa tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:08.221437 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-ddd19593-c2cf-4eab-b6ba-8cb2dd62e3fa tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1448 microversion: 2.1 time: 0.166583 Feb 08 16:51:08.221996 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 557/1121] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:08 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1448 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:51:08.429656 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-0c5b52ab-a296-4797-ad38-a3f630175a9d tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:08.430266 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-0c5b52ab-a296-4797-ad38-a3f630175a9d tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:08.436121 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0c5b52ab-a296-4797-ad38-a3f630175a9d tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:08.436606 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0c5b52ab-a296-4797-ad38-a3f630175a9d tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:08.437444 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0c5b52ab-a296-4797-ad38-a3f630175a9d tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:08.437884 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0c5b52ab-a296-4797-ad38-a3f630175a9d tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:08.578973 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-0c5b52ab-a296-4797-ad38-a3f630175a9d tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:08.586313 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-0c5b52ab-a296-4797-ad38-a3f630175a9d tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 200 len: 1267 microversion: 2.1 time: 0.160334 Feb 08 16:51:08.586890 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 565/1122] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:08 2022] GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:51:08.652120 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-636affb6-4bb8-4cab-9d61-76b563a2a956 req-e90be3f5-97b7-47aa-8392-ace659150665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37885d5b-9597-417c-9d29-bd637383943d", "tag": "27712d05-cbfb-45c1-a1bc-a52d3f0584e7"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:51:08.654318 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:51:08.654318 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:51:08.661438 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-636affb6-4bb8-4cab-9d61-76b563a2a956 req-e90be3f5-97b7-47aa-8392-ace659150665 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:08.662005 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-636affb6-4bb8-4cab-9d61-76b563a2a956 req-e90be3f5-97b7-47aa-8392-ace659150665 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:08.673291 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-636affb6-4bb8-4cab-9d61-76b563a2a956 req-e90be3f5-97b7-47aa-8392-ace659150665 service nova] Creating event network-changed:27712d05-cbfb-45c1-a1bc-a52d3f0584e7 for instance 37885d5b-9597-417c-9d29-bd637383943d on hv-cinder-82786 Feb 08 16:51:08.677990 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-636affb6-4bb8-4cab-9d61-76b563a2a956 req-e90be3f5-97b7-47aa-8392-ace659150665 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029468 Feb 08 16:51:08.678567 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 558/1123] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:51:08.718355 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-47661d02-fd34-4f8d-9ccf-35fad7df83ad tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:08.718963 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-47661d02-fd34-4f8d-9ccf-35fad7df83ad tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:08.725088 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-47661d02-fd34-4f8d-9ccf-35fad7df83ad tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:08.725574 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-47661d02-fd34-4f8d-9ccf-35fad7df83ad tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:08.726543 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-47661d02-fd34-4f8d-9ccf-35fad7df83ad tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:08.726980 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-47661d02-fd34-4f8d-9ccf-35fad7df83ad tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:08.980024 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-47661d02-fd34-4f8d-9ccf-35fad7df83ad tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:08.992548 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-47661d02-fd34-4f8d-9ccf-35fad7df83ad tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:08.994117 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-47661d02-fd34-4f8d-9ccf-35fad7df83ad tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:08.998129 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-47661d02-fd34-4f8d-9ccf-35fad7df83ad tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1738 microversion: 2.20 time: 0.283868 Feb 08 16:51:09.002603 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 566/1124] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:08 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1738 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:09.240724 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b9cbf7f4-399e-4571-9537-ca5ef8d41792 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:09.242160 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-b9cbf7f4-399e-4571-9537-ca5ef8d41792 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:09.255647 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b9cbf7f4-399e-4571-9537-ca5ef8d41792 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:09.256407 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b9cbf7f4-399e-4571-9537-ca5ef8d41792 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:09.257464 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b9cbf7f4-399e-4571-9537-ca5ef8d41792 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:09.258055 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b9cbf7f4-399e-4571-9537-ca5ef8d41792 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:09.491795 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-b9cbf7f4-399e-4571-9537-ca5ef8d41792 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:09.505109 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-b9cbf7f4-399e-4571-9537-ca5ef8d41792 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1448 microversion: 2.1 time: 0.268659 Feb 08 16:51:09.517583 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 559/1125] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:09 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1448 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:51:09.604232 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-7f6969dc-2060-43ba-8ca6-ca59edf23d98 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:09.605230 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-7f6969dc-2060-43ba-8ca6-ca59edf23d98 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:09.612180 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7f6969dc-2060-43ba-8ca6-ca59edf23d98 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:09.612921 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7f6969dc-2060-43ba-8ca6-ca59edf23d98 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:09.613906 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7f6969dc-2060-43ba-8ca6-ca59edf23d98 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:09.614516 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-7f6969dc-2060-43ba-8ca6-ca59edf23d98 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:09.867332 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-0699c8b7-4185-4bc6-b2ff-c25106403afe req-48359873-be38-45a7-a314-ffb95f516302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f5b0dab-9c28-4519-a6f6-c98d7c9a5287", "name": "network-vif-deleted", "tag": "6f04fb2f-d81d-42f0-8c53-184ef0859a38"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:51:09.869651 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:51:09.869651 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:51:09.886896 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-0699c8b7-4185-4bc6-b2ff-c25106403afe req-48359873-be38-45a7-a314-ffb95f516302 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:09.892536 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-0699c8b7-4185-4bc6-b2ff-c25106403afe req-48359873-be38-45a7-a314-ffb95f516302 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:09.929036 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-0699c8b7-4185-4bc6-b2ff-c25106403afe req-48359873-be38-45a7-a314-ffb95f516302 service nova] Creating event network-vif-deleted:6f04fb2f-d81d-42f0-8c53-184ef0859a38 for instance 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 on hv-cinder-82786 Feb 08 16:51:09.941191 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-7f6969dc-2060-43ba-8ca6-ca59edf23d98 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:09.947222 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-0699c8b7-4185-4bc6-b2ff-c25106403afe req-48359873-be38-45a7-a314-ffb95f516302 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083611 Feb 08 16:51:09.954227 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 560/1126] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:51:09.954943 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-7f6969dc-2060-43ba-8ca6-ca59edf23d98 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 200 len: 1267 microversion: 2.1 time: 0.354088 Feb 08 16:51:09.965345 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 567/1127] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:09 2022] GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 1267 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:51:10.021136 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-46e31161-89dc-498c-a873-5e114247144d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:10.021945 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-46e31161-89dc-498c-a873-5e114247144d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:10.029752 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-46e31161-89dc-498c-a873-5e114247144d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:10.030483 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-46e31161-89dc-498c-a873-5e114247144d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:10.031502 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-46e31161-89dc-498c-a873-5e114247144d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:10.032139 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-46e31161-89dc-498c-a873-5e114247144d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:10.222854 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-46e31161-89dc-498c-a873-5e114247144d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:10.238405 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-46e31161-89dc-498c-a873-5e114247144d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:10.240252 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-46e31161-89dc-498c-a873-5e114247144d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:10.241738 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-46e31161-89dc-498c-a873-5e114247144d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1738 microversion: 2.20 time: 0.225063 Feb 08 16:51:10.254058 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 561/1128] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:10 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:10.525744 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-51d6a0d5-b34e-455b-a42a-273787533917 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:10.526282 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-51d6a0d5-b34e-455b-a42a-273787533917 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:10.534065 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-51d6a0d5-b34e-455b-a42a-273787533917 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:10.534453 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-51d6a0d5-b34e-455b-a42a-273787533917 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:10.535323 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-51d6a0d5-b34e-455b-a42a-273787533917 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:10.535825 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-51d6a0d5-b34e-455b-a42a-273787533917 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:10.572296 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-51d6a0d5-b34e-455b-a42a-273787533917 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:10.572755 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-51d6a0d5-b34e-455b-a42a-273787533917 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:10.573422 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.objects.instance [None req-51d6a0d5-b34e-455b-a42a-273787533917 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lazy-loading 'fault' on Instance uuid 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 {{(pid=122902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:51:10.621880 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-51d6a0d5-b34e-455b-a42a-273787533917 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bb4f5ad936444093f3115c65c441b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bc94fd80244144ae5883c54707e219', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:10.633940 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-51d6a0d5-b34e-455b-a42a-273787533917 tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 200 len: 1224 microversion: 2.1 time: 0.111681 Feb 08 16:51:10.634683 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 568/1129] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:10 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 1224 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:51:10.971865 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-2d67df19-f1d7-444f-aa02-de9d512cfa99 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:10.972736 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-2d67df19-f1d7-444f-aa02-de9d512cfa99 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:10.979312 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2d67df19-f1d7-444f-aa02-de9d512cfa99 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:10.979888 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2d67df19-f1d7-444f-aa02-de9d512cfa99 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:10.980901 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2d67df19-f1d7-444f-aa02-de9d512cfa99 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:10.981579 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-2d67df19-f1d7-444f-aa02-de9d512cfa99 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:11.129682 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-2d67df19-f1d7-444f-aa02-de9d512cfa99 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:11.137940 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-2d67df19-f1d7-444f-aa02-de9d512cfa99 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 200 len: 1267 microversion: 2.1 time: 0.169683 Feb 08 16:51:11.138653 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 562/1130] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:10 2022] GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:51:11.261895 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-ce2d20e8-56cf-4858-acf0-00834bffae12 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:11.263157 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-ce2d20e8-56cf-4858-acf0-00834bffae12 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:11.270686 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ce2d20e8-56cf-4858-acf0-00834bffae12 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:11.271144 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ce2d20e8-56cf-4858-acf0-00834bffae12 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:11.271980 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ce2d20e8-56cf-4858-acf0-00834bffae12 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:11.272558 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-ce2d20e8-56cf-4858-acf0-00834bffae12 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:11.424750 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ce2d20e8-56cf-4858-acf0-00834bffae12 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:11.436337 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ce2d20e8-56cf-4858-acf0-00834bffae12 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:11.438151 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-ce2d20e8-56cf-4858-acf0-00834bffae12 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:11.439544 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-ce2d20e8-56cf-4858-acf0-00834bffae12 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1738 microversion: 2.20 time: 0.181437 Feb 08 16:51:11.440134 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 569/1131] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:11 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:11.654099 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-109b333c-6810-4165-abf6-5201e037078b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:11.654099 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-109b333c-6810-4165-abf6-5201e037078b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] [instance: 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:11.660778 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-109b333c-6810-4165-abf6-5201e037078b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:11.661257 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-109b333c-6810-4165-abf6-5201e037078b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:11.662053 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-109b333c-6810-4165-abf6-5201e037078b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:11.663997 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-109b333c-6810-4165-abf6-5201e037078b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:11.682180 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.wsgi [None req-109b333c-6810-4165-abf6-5201e037078b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] HTTP exception thrown: Instance 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 could not be found. Feb 08 16:51:11.682830 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-109b333c-6810-4165-abf6-5201e037078b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Returning 404 to user: Instance 9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 could not be found. {{(pid=122901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:51:11.683723 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-109b333c-6810-4165-abf6-5201e037078b tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287" status: 404 len: 111 microversion: 2.1 time: 0.034885 Feb 08 16:51:11.686250 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 563/1132] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:11 2022] GET /compute/v2.1/servers/9f5b0dab-9c28-4519-a6f6-c98d7c9a5287 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:51:11.856052 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-375faf27-374f-4329-b1dc-07ed4359c6aa tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] Calling method '.version_select at 0x7fcde01ba8b0>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:11.890539 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-375faf27-374f-4329-b1dc-07ed4359c6aa tempest-TestShelveInstance-170103087 tempest-TestShelveInstance-170103087-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-887258110" status: 202 len: 0 microversion: 2.1 time: 0.038258 Feb 08 16:51:11.893025 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 570/1133] 10.222.0.35 () {58 vars in 1250 bytes} [Tue Feb 8 16:51:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-887258110 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:51:12.157497 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-89acf6ad-b051-44bf-a4f0-c67b1f68e000 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:12.159320 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-89acf6ad-b051-44bf-a4f0-c67b1f68e000 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:12.166775 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-89acf6ad-b051-44bf-a4f0-c67b1f68e000 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:12.167436 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-89acf6ad-b051-44bf-a4f0-c67b1f68e000 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:12.169234 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-89acf6ad-b051-44bf-a4f0-c67b1f68e000 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:12.170413 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-89acf6ad-b051-44bf-a4f0-c67b1f68e000 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:12.403838 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-89acf6ad-b051-44bf-a4f0-c67b1f68e000 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:12.411914 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-89acf6ad-b051-44bf-a4f0-c67b1f68e000 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 200 len: 1267 microversion: 2.1 time: 0.261236 Feb 08 16:51:12.421442 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 564/1134] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:12 2022] GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 1267 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:51:12.462614 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-9d1a1a4b-099f-4330-b92e-0b57efc21cc7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:12.463427 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-9d1a1a4b-099f-4330-b92e-0b57efc21cc7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:12.470017 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9d1a1a4b-099f-4330-b92e-0b57efc21cc7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:12.470473 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9d1a1a4b-099f-4330-b92e-0b57efc21cc7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:12.471310 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9d1a1a4b-099f-4330-b92e-0b57efc21cc7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:12.471917 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9d1a1a4b-099f-4330-b92e-0b57efc21cc7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:12.633874 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9d1a1a4b-099f-4330-b92e-0b57efc21cc7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:12.645692 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9d1a1a4b-099f-4330-b92e-0b57efc21cc7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:12.648517 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9d1a1a4b-099f-4330-b92e-0b57efc21cc7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:12.650127 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-9d1a1a4b-099f-4330-b92e-0b57efc21cc7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1738 microversion: 2.20 time: 0.191463 Feb 08 16:51:12.651459 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 571/1135] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:12 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:13.430057 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-20d85d97-dede-4c6d-ad17-5545e05ff8f7 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:13.431467 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-20d85d97-dede-4c6d-ad17-5545e05ff8f7 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:13.438906 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-20d85d97-dede-4c6d-ad17-5545e05ff8f7 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:13.441994 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-20d85d97-dede-4c6d-ad17-5545e05ff8f7 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:13.443128 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-20d85d97-dede-4c6d-ad17-5545e05ff8f7 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:13.443780 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-20d85d97-dede-4c6d-ad17-5545e05ff8f7 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:13.674257 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-9c066695-2c6c-41ff-a42f-b43d3913e666 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:13.674812 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-9c066695-2c6c-41ff-a42f-b43d3913e666 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:13.681837 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9c066695-2c6c-41ff-a42f-b43d3913e666 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:13.682293 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9c066695-2c6c-41ff-a42f-b43d3913e666 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:13.683322 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9c066695-2c6c-41ff-a42f-b43d3913e666 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:13.683818 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9c066695-2c6c-41ff-a42f-b43d3913e666 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:13.752020 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-20d85d97-dede-4c6d-ad17-5545e05ff8f7 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:13.760945 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-20d85d97-dede-4c6d-ad17-5545e05ff8f7 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 200 len: 1267 microversion: 2.1 time: 0.335145 Feb 08 16:51:13.767384 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 565/1136] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:13 2022] GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 1267 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:51:13.869231 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9c066695-2c6c-41ff-a42f-b43d3913e666 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:13.886938 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9c066695-2c6c-41ff-a42f-b43d3913e666 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:13.897136 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9c066695-2c6c-41ff-a42f-b43d3913e666 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:13.898657 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-9c066695-2c6c-41ff-a42f-b43d3913e666 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1738 microversion: 2.20 time: 0.228564 Feb 08 16:51:13.913018 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 572/1137] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:13 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1738 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:14.783363 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-0c3feee2-d03c-44d2-ad86-3b394dad7a36 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:14.784672 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-0c3feee2-d03c-44d2-ad86-3b394dad7a36 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:14.800497 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0c3feee2-d03c-44d2-ad86-3b394dad7a36 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:14.801155 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0c3feee2-d03c-44d2-ad86-3b394dad7a36 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:14.801982 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0c3feee2-d03c-44d2-ad86-3b394dad7a36 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:14.802498 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0c3feee2-d03c-44d2-ad86-3b394dad7a36 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:14.925063 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-39745894-b76f-4645-ae2d-95ec36bb0d7d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:14.926319 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-39745894-b76f-4645-ae2d-95ec36bb0d7d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:14.941292 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-39745894-b76f-4645-ae2d-95ec36bb0d7d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:14.942774 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-39745894-b76f-4645-ae2d-95ec36bb0d7d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:14.943964 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-39745894-b76f-4645-ae2d-95ec36bb0d7d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:14.944659 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-39745894-b76f-4645-ae2d-95ec36bb0d7d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:15.060345 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-0c3feee2-d03c-44d2-ad86-3b394dad7a36 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:15.073128 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-0c3feee2-d03c-44d2-ad86-3b394dad7a36 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 200 len: 1267 microversion: 2.1 time: 0.293919 Feb 08 16:51:15.074259 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 566/1138] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:14 2022] GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 1267 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:51:15.159398 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-39745894-b76f-4645-ae2d-95ec36bb0d7d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:15.170305 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-39745894-b76f-4645-ae2d-95ec36bb0d7d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:15.172527 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-39745894-b76f-4645-ae2d-95ec36bb0d7d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:15.174368 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-39745894-b76f-4645-ae2d-95ec36bb0d7d tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1738 microversion: 2.20 time: 0.253344 Feb 08 16:51:15.188625 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 573/1139] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:14 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1738 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:16.090308 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-fad0a0f7-1a62-4f30-8f79-1d92fe23ce52 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:16.091127 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-fad0a0f7-1a62-4f30-8f79-1d92fe23ce52 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:16.100623 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fad0a0f7-1a62-4f30-8f79-1d92fe23ce52 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:16.102506 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fad0a0f7-1a62-4f30-8f79-1d92fe23ce52 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:16.108441 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fad0a0f7-1a62-4f30-8f79-1d92fe23ce52 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:16.109397 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-fad0a0f7-1a62-4f30-8f79-1d92fe23ce52 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:16.195104 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-9a1bbc0e-601b-4b12-a692-5a50a643c956 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:16.196623 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-9a1bbc0e-601b-4b12-a692-5a50a643c956 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:16.203927 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9a1bbc0e-601b-4b12-a692-5a50a643c956 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:16.204614 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9a1bbc0e-601b-4b12-a692-5a50a643c956 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:16.205601 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9a1bbc0e-601b-4b12-a692-5a50a643c956 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:16.206208 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9a1bbc0e-601b-4b12-a692-5a50a643c956 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:16.456448 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9a1bbc0e-601b-4b12-a692-5a50a643c956 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:16.469481 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9a1bbc0e-601b-4b12-a692-5a50a643c956 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:16.471302 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9a1bbc0e-601b-4b12-a692-5a50a643c956 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:16.472532 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-9a1bbc0e-601b-4b12-a692-5a50a643c956 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1738 microversion: 2.20 time: 0.282799 Feb 08 16:51:16.487855 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 574/1140] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:16 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1738 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:51:16.527717 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-fad0a0f7-1a62-4f30-8f79-1d92fe23ce52 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:16.536577 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-fad0a0f7-1a62-4f30-8f79-1d92fe23ce52 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 200 len: 1267 microversion: 2.1 time: 0.450135 Feb 08 16:51:16.537745 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 567/1141] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:16 2022] GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 1267 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:51:17.493169 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e49acd7d-412e-4041-8d09-318b1c31dc00 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:17.494667 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e49acd7d-412e-4041-8d09-318b1c31dc00 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:17.505519 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e49acd7d-412e-4041-8d09-318b1c31dc00 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:17.507163 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e49acd7d-412e-4041-8d09-318b1c31dc00 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:17.508216 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e49acd7d-412e-4041-8d09-318b1c31dc00 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:17.508813 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e49acd7d-412e-4041-8d09-318b1c31dc00 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:17.555820 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-5a529751-77b3-48ad-940a-2a35339a93d5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:17.557232 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-5a529751-77b3-48ad-940a-2a35339a93d5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:17.572494 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5a529751-77b3-48ad-940a-2a35339a93d5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:17.581136 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5a529751-77b3-48ad-940a-2a35339a93d5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:17.582363 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5a529751-77b3-48ad-940a-2a35339a93d5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:17.583004 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5a529751-77b3-48ad-940a-2a35339a93d5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:17.873788 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-5a529751-77b3-48ad-940a-2a35339a93d5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:17.887529 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-5a529751-77b3-48ad-940a-2a35339a93d5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 200 len: 1267 microversion: 2.1 time: 0.336610 Feb 08 16:51:17.897386 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 568/1142] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:17 2022] GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 1267 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:51:18.013763 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e49acd7d-412e-4041-8d09-318b1c31dc00 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:18.025858 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e49acd7d-412e-4041-8d09-318b1c31dc00 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:18.030524 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e49acd7d-412e-4041-8d09-318b1c31dc00 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:18.033325 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e49acd7d-412e-4041-8d09-318b1c31dc00 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1738 microversion: 2.20 time: 0.543843 Feb 08 16:51:18.033975 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 575/1143] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:17 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1738 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:18.477983 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-72027a6a-b39b-4a0f-8530-95bf7ca6563d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:18.478587 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-72027a6a-b39b-4a0f-8530-95bf7ca6563d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:18.488157 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-72027a6a-b39b-4a0f-8530-95bf7ca6563d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:18.488717 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-72027a6a-b39b-4a0f-8530-95bf7ca6563d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:18.492415 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-72027a6a-b39b-4a0f-8530-95bf7ca6563d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:18.492944 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-72027a6a-b39b-4a0f-8530-95bf7ca6563d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:18.572010 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-72027a6a-b39b-4a0f-8530-95bf7ca6563d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-volume_attachments/cf7a889e-8621-4a1e-b367-4e593f885b3f" status: 200 len: 194 microversion: 2.1 time: 0.097633 Feb 08 16:51:18.573522 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 569/1144] 10.222.0.35 () {58 vars in 1412 bytes} [Tue Feb 8 16:51:18 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-volume_attachments/cf7a889e-8621-4a1e-b367-4e593f885b3f => generated 194 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:51:18.583455 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e79e1595-6268-4465-bf75-36c9229cf259 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:18.584573 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e79e1595-6268-4465-bf75-36c9229cf259 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:18.592628 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e79e1595-6268-4465-bf75-36c9229cf259 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:18.593432 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e79e1595-6268-4465-bf75-36c9229cf259 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:18.594443 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e79e1595-6268-4465-bf75-36c9229cf259 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:18.595107 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-e79e1595-6268-4465-bf75-36c9229cf259 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:18.738620 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.objects.instance [None req-e79e1595-6268-4465-bf75-36c9229cf259 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lazy-loading 'services' on Instance uuid b69ba823-eca2-461c-849e-746060cb934b {{(pid=122902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:51:18.825994 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e79e1595-6268-4465-bf75-36c9229cf259 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-volume_attachments/cf7a889e-8621-4a1e-b367-4e593f885b3f" status: 202 len: 0 microversion: 2.1 time: 0.246022 Feb 08 16:51:18.827066 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 576/1145] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Feb 8 16:51:18 2022] DELETE /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-volume_attachments/cf7a889e-8621-4a1e-b367-4e593f885b3f => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 08 16:51:18.904323 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-c65f65ea-44dc-45f1-8ffd-ccb1fbf12fc8 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:18.905176 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-c65f65ea-44dc-45f1-8ffd-ccb1fbf12fc8 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:18.911911 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c65f65ea-44dc-45f1-8ffd-ccb1fbf12fc8 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:18.912608 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c65f65ea-44dc-45f1-8ffd-ccb1fbf12fc8 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:18.913632 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c65f65ea-44dc-45f1-8ffd-ccb1fbf12fc8 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:18.915521 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c65f65ea-44dc-45f1-8ffd-ccb1fbf12fc8 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:19.061186 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-6ebb8532-ebfa-45fa-8220-4204666f4049 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:19.061878 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-6ebb8532-ebfa-45fa-8220-4204666f4049 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:19.068735 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6ebb8532-ebfa-45fa-8220-4204666f4049 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:19.069456 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6ebb8532-ebfa-45fa-8220-4204666f4049 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:19.070470 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6ebb8532-ebfa-45fa-8220-4204666f4049 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:19.071086 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6ebb8532-ebfa-45fa-8220-4204666f4049 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:19.246593 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-6ebb8532-ebfa-45fa-8220-4204666f4049 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:19.254708 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c65f65ea-44dc-45f1-8ffd-ccb1fbf12fc8 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:19.256521 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-6ebb8532-ebfa-45fa-8220-4204666f4049 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:19.258172 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-6ebb8532-ebfa-45fa-8220-4204666f4049 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:19.259538 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-6ebb8532-ebfa-45fa-8220-4204666f4049 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1738 microversion: 2.20 time: 0.203134 Feb 08 16:51:19.260366 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 577/1146] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:19 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:51:19.266359 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-c65f65ea-44dc-45f1-8ffd-ccb1fbf12fc8 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 200 len: 1267 microversion: 2.1 time: 0.365412 Feb 08 16:51:19.273993 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 570/1147] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:18 2022] GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 1267 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:51:19.714259 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-1fb57bd0-ca80-4cc4-8ec0-340b4fc955b6 req-4a2dc373-7e3f-4008-b461-3d2d3b0d1b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37885d5b-9597-417c-9d29-bd637383943d", "name": "network-vif-plugged", "status": "completed", "tag": "27712d05-cbfb-45c1-a1bc-a52d3f0584e7"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:51:19.716730 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:51:19.716730 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:51:19.724392 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-1fb57bd0-ca80-4cc4-8ec0-340b4fc955b6 req-4a2dc373-7e3f-4008-b461-3d2d3b0d1b70 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:19.724931 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-1fb57bd0-ca80-4cc4-8ec0-340b4fc955b6 req-4a2dc373-7e3f-4008-b461-3d2d3b0d1b70 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:19.736769 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-1fb57bd0-ca80-4cc4-8ec0-340b4fc955b6 req-4a2dc373-7e3f-4008-b461-3d2d3b0d1b70 service nova] Creating event network-vif-plugged:27712d05-cbfb-45c1-a1bc-a52d3f0584e7 for instance 37885d5b-9597-417c-9d29-bd637383943d on hv-cinder-82786 Feb 08 16:51:19.741554 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-1fb57bd0-ca80-4cc4-8ec0-340b4fc955b6 req-4a2dc373-7e3f-4008-b461-3d2d3b0d1b70 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031002 Feb 08 16:51:19.742154 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 578/1148] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:51:20.284371 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-516e8397-1b7a-4e89-a96b-93eacf07e60c tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:20.284633 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-516e8397-1b7a-4e89-a96b-93eacf07e60c tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:20.285024 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-a14b5f1d-6c21-4529-a996-9ea241424353 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:20.289262 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-a14b5f1d-6c21-4529-a996-9ea241424353 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:20.297476 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-516e8397-1b7a-4e89-a96b-93eacf07e60c tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:20.297933 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-516e8397-1b7a-4e89-a96b-93eacf07e60c tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:20.299432 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-516e8397-1b7a-4e89-a96b-93eacf07e60c tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:20.299432 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-516e8397-1b7a-4e89-a96b-93eacf07e60c tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:20.302825 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a14b5f1d-6c21-4529-a996-9ea241424353 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:20.306536 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a14b5f1d-6c21-4529-a996-9ea241424353 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:20.310550 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a14b5f1d-6c21-4529-a996-9ea241424353 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:20.312786 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a14b5f1d-6c21-4529-a996-9ea241424353 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:20.546792 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-a14b5f1d-6c21-4529-a996-9ea241424353 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:20.555696 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-a14b5f1d-6c21-4529-a996-9ea241424353 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:20.557269 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-a14b5f1d-6c21-4529-a996-9ea241424353 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:20.558434 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-a14b5f1d-6c21-4529-a996-9ea241424353 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1720 microversion: 2.20 time: 0.284140 Feb 08 16:51:20.560908 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 571/1149] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:20 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1720 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:51:20.625912 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-516e8397-1b7a-4e89-a96b-93eacf07e60c tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:20.633247 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-516e8397-1b7a-4e89-a96b-93eacf07e60c tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 200 len: 1267 microversion: 2.1 time: 0.353527 Feb 08 16:51:20.634029 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 579/1150] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:20 2022] GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 1267 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:51:21.037176 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-1a31cb30-c0be-40c1-a3be-678fe41845d0 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:21.037678 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-1a31cb30-c0be-40c1-a3be-678fe41845d0 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:21.044100 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1a31cb30-c0be-40c1-a3be-678fe41845d0 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:21.044552 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1a31cb30-c0be-40c1-a3be-678fe41845d0 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:21.045342 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1a31cb30-c0be-40c1-a3be-678fe41845d0 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:21.045800 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1a31cb30-c0be-40c1-a3be-678fe41845d0 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:21.075621 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-1a31cb30-c0be-40c1-a3be-678fe41845d0 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-volume_attachments/786aa985-d10d-48c1-a43a-188b9c11254e" status: 200 len: 194 microversion: 2.1 time: 0.043213 Feb 08 16:51:21.081070 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 572/1151] 10.222.0.35 () {58 vars in 1412 bytes} [Tue Feb 8 16:51:21 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-volume_attachments/786aa985-d10d-48c1-a43a-188b9c11254e => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:51:21.085740 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-fb80bcd0-10be-4995-b6ba-b15a6eb275e9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:21.086234 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-fb80bcd0-10be-4995-b6ba-b15a6eb275e9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:21.093545 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb80bcd0-10be-4995-b6ba-b15a6eb275e9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:21.094191 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb80bcd0-10be-4995-b6ba-b15a6eb275e9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:21.095158 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb80bcd0-10be-4995-b6ba-b15a6eb275e9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:21.095978 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb80bcd0-10be-4995-b6ba-b15a6eb275e9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:21.177486 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.objects.instance [None req-fb80bcd0-10be-4995-b6ba-b15a6eb275e9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lazy-loading 'services' on Instance uuid b69ba823-eca2-461c-849e-746060cb934b {{(pid=122902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:51:21.249694 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-fb80bcd0-10be-4995-b6ba-b15a6eb275e9 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-volume_attachments/786aa985-d10d-48c1-a43a-188b9c11254e" status: 202 len: 0 microversion: 2.1 time: 0.167453 Feb 08 16:51:21.250359 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 580/1152] 10.222.0.35 () {58 vars in 1415 bytes} [Tue Feb 8 16:51:21 2022] DELETE /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-volume_attachments/786aa985-d10d-48c1-a43a-188b9c11254e => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:51:21.579016 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-cfae3315-d392-46ad-b078-a3204ef83e69 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:21.579633 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-cfae3315-d392-46ad-b078-a3204ef83e69 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:21.585824 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cfae3315-d392-46ad-b078-a3204ef83e69 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:21.586282 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cfae3315-d392-46ad-b078-a3204ef83e69 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:21.587065 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cfae3315-d392-46ad-b078-a3204ef83e69 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:21.587507 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cfae3315-d392-46ad-b078-a3204ef83e69 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:21.650545 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-a2734261-21a8-450a-a93a-bf9a3a98c77b tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:21.651316 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-a2734261-21a8-450a-a93a-bf9a3a98c77b tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:21.658583 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a2734261-21a8-450a-a93a-bf9a3a98c77b tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:21.659133 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a2734261-21a8-450a-a93a-bf9a3a98c77b tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:21.660043 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a2734261-21a8-450a-a93a-bf9a3a98c77b tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:21.660550 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a2734261-21a8-450a-a93a-bf9a3a98c77b tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:21.757706 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-cfae3315-d392-46ad-b078-a3204ef83e69 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:21.766917 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-cfae3315-d392-46ad-b078-a3204ef83e69 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:21.768713 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-cfae3315-d392-46ad-b078-a3204ef83e69 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:21.769983 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-cfae3315-d392-46ad-b078-a3204ef83e69 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1720 microversion: 2.20 time: 0.195585 Feb 08 16:51:21.770672 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 573/1153] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:21 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1720 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:21.836043 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-a2734261-21a8-450a-a93a-bf9a3a98c77b tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:21.847746 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-a2734261-21a8-450a-a93a-bf9a3a98c77b tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 200 len: 1267 microversion: 2.1 time: 0.201458 Feb 08 16:51:21.860130 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 581/1154] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:21 2022] GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:51:22.415250 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-9de4a185-29cb-44b1-99bf-80492a65373f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:22.416215 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-9de4a185-29cb-44b1-99bf-80492a65373f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:22.422406 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9de4a185-29cb-44b1-99bf-80492a65373f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:22.422861 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9de4a185-29cb-44b1-99bf-80492a65373f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:22.423643 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9de4a185-29cb-44b1-99bf-80492a65373f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:22.424108 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-9de4a185-29cb-44b1-99bf-80492a65373f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:22.454990 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-9de4a185-29cb-44b1-99bf-80492a65373f tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043581 Feb 08 16:51:22.455575 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 574/1155] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:51:22 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 08 16:51:22.555999 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-8152c0ff-c8c0-4ac1-9989-d79e61147218 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:22.556984 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-8152c0ff-c8c0-4ac1-9989-d79e61147218 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:22.563471 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8152c0ff-c8c0-4ac1-9989-d79e61147218 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:22.563984 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8152c0ff-c8c0-4ac1-9989-d79e61147218 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:22.564829 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8152c0ff-c8c0-4ac1-9989-d79e61147218 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:22.565299 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-8152c0ff-c8c0-4ac1-9989-d79e61147218 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:22.596033 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-8152c0ff-c8c0-4ac1-9989-d79e61147218 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043509 Feb 08 16:51:22.596796 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 582/1156] 10.222.0.35 () {58 vars in 1301 bytes} [Tue Feb 8 16:51:22 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 08 16:51:22.651001 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-201cc18d-7bbf-47a2-b80c-e86c89419668 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:22.651499 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-201cc18d-7bbf-47a2-b80c-e86c89419668 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:22.658735 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-201cc18d-7bbf-47a2-b80c-e86c89419668 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:22.659193 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-201cc18d-7bbf-47a2-b80c-e86c89419668 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:22.660012 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-201cc18d-7bbf-47a2-b80c-e86c89419668 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:22.660456 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-201cc18d-7bbf-47a2-b80c-e86c89419668 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:22.684514 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-201cc18d-7bbf-47a2-b80c-e86c89419668 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Going to try to terminate instance {{(pid=122901) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 16:51:22.757995 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-201cc18d-7bbf-47a2-b80c-e86c89419668 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b" status: 204 len: 0 microversion: 2.1 time: 0.110206 Feb 08 16:51:22.758680 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 575/1157] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Feb 8 16:51:22 2022] DELETE /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 16:51:22.767675 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-9bae117f-91f3-4162-b085-d077687bf01a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:22.768369 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-9bae117f-91f3-4162-b085-d077687bf01a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:22.774186 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9bae117f-91f3-4162-b085-d077687bf01a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:22.774637 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9bae117f-91f3-4162-b085-d077687bf01a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:22.775414 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9bae117f-91f3-4162-b085-d077687bf01a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:22.775887 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9bae117f-91f3-4162-b085-d077687bf01a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:22.788682 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-6a5e98c3-822b-437a-9cbf-05367948750e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:22.789402 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-6a5e98c3-822b-437a-9cbf-05367948750e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:22.795303 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6a5e98c3-822b-437a-9cbf-05367948750e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:22.795747 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6a5e98c3-822b-437a-9cbf-05367948750e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:22.796552 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6a5e98c3-822b-437a-9cbf-05367948750e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:22.796983 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-6a5e98c3-822b-437a-9cbf-05367948750e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:22.920894 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9bae117f-91f3-4162-b085-d077687bf01a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:22.928854 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-9bae117f-91f3-4162-b085-d077687bf01a tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b" status: 200 len: 1672 microversion: 2.1 time: 0.164946 Feb 08 16:51:22.929526 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 583/1158] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:22 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:51:22.934693 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-3645542b-11f7-4ae0-a543-7b3efa88fe64 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:22.935704 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-3645542b-11f7-4ae0-a543-7b3efa88fe64 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:22.941581 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3645542b-11f7-4ae0-a543-7b3efa88fe64 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:22.942106 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3645542b-11f7-4ae0-a543-7b3efa88fe64 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:22.943163 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3645542b-11f7-4ae0-a543-7b3efa88fe64 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:22.943708 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3645542b-11f7-4ae0-a543-7b3efa88fe64 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:22.954796 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-6a5e98c3-822b-437a-9cbf-05367948750e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:22.962971 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-6a5e98c3-822b-437a-9cbf-05367948750e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:22.964636 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-6a5e98c3-822b-437a-9cbf-05367948750e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:22.966839 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-6a5e98c3-822b-437a-9cbf-05367948750e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1720 microversion: 2.20 time: 0.182119 Feb 08 16:51:22.967545 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 576/1159] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:22 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:51:23.089917 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3645542b-11f7-4ae0-a543-7b3efa88fe64 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:23.097539 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-3645542b-11f7-4ae0-a543-7b3efa88fe64 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 200 len: 1453 microversion: 2.1 time: 0.167021 Feb 08 16:51:23.098103 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 584/1160] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:22 2022] GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:51:23.113265 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b6b9dc57-6fef-4803-9a35-b6722381af49 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:23.113876 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-b6b9dc57-6fef-4803-9a35-b6722381af49 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:23.119579 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b6b9dc57-6fef-4803-9a35-b6722381af49 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:23.120067 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b6b9dc57-6fef-4803-9a35-b6722381af49 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:23.120845 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b6b9dc57-6fef-4803-9a35-b6722381af49 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:23.121804 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b6b9dc57-6fef-4803-9a35-b6722381af49 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:23.253699 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-b6b9dc57-6fef-4803-9a35-b6722381af49 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:23.261158 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-b6b9dc57-6fef-4803-9a35-b6722381af49 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 200 len: 1453 microversion: 2.1 time: 0.151445 Feb 08 16:51:23.263910 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 577/1161] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:23 2022] GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:51:23.679854 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-1e91e22d-b6f6-4263-a0da-f671b510e0d3 req-3086ed16-1f80-4c65-a7f7-390d1b827707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a6041b-b9e3-4224-b52e-265ff88bb57e", "name": "network-vif-unplugged", "status": "completed", "tag": "a1385bb4-6242-43a5-80b9-5e5963fd66f2"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:51:23.681553 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:51:23.681553 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:51:23.690597 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-1e91e22d-b6f6-4263-a0da-f671b510e0d3 req-3086ed16-1f80-4c65-a7f7-390d1b827707 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:23.691185 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-1e91e22d-b6f6-4263-a0da-f671b510e0d3 req-3086ed16-1f80-4c65-a7f7-390d1b827707 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:23.703777 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.compute.server_external_events [req-1e91e22d-b6f6-4263-a0da-f671b510e0d3 req-3086ed16-1f80-4c65-a7f7-390d1b827707 service nova] Unable to find a host for instance 71a6041b-b9e3-4224-b52e-265ff88bb57e. Dropping event network-vif-unplugged {{(pid=122902) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 08 16:51:23.705015 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-1e91e22d-b6f6-4263-a0da-f671b510e0d3 req-3086ed16-1f80-4c65-a7f7-390d1b827707 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029206 Feb 08 16:51:23.705844 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 585/1162] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Feb 08 16:51:23.946242 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-5dc779a1-0137-4ebc-880f-f3ea5f2bf213 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:23.946862 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-5dc779a1-0137-4ebc-880f-f3ea5f2bf213 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:23.953905 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5dc779a1-0137-4ebc-880f-f3ea5f2bf213 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:23.954360 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5dc779a1-0137-4ebc-880f-f3ea5f2bf213 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:23.955162 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5dc779a1-0137-4ebc-880f-f3ea5f2bf213 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:23.955606 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-5dc779a1-0137-4ebc-880f-f3ea5f2bf213 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:23.986299 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-12d978ef-57ab-438c-b0bb-bb51c9413636 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:23.986885 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-12d978ef-57ab-438c-b0bb-bb51c9413636 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:23.993110 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-12d978ef-57ab-438c-b0bb-bb51c9413636 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:23.993575 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-12d978ef-57ab-438c-b0bb-bb51c9413636 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:23.994424 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-12d978ef-57ab-438c-b0bb-bb51c9413636 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:23.994866 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-12d978ef-57ab-438c-b0bb-bb51c9413636 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:24.108752 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-5dc779a1-0137-4ebc-880f-f3ea5f2bf213 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:24.116516 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-5dc779a1-0137-4ebc-880f-f3ea5f2bf213 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b" status: 200 len: 1672 microversion: 2.1 time: 0.173924 Feb 08 16:51:24.117168 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 578/1163] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:23 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b => generated 1672 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:51:24.285394 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-12d978ef-57ab-438c-b0bb-bb51c9413636 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:24.293293 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-12d978ef-57ab-438c-b0bb-bb51c9413636 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:24.294808 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-12d978ef-57ab-438c-b0bb-bb51c9413636 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:24.296012 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-12d978ef-57ab-438c-b0bb-bb51c9413636 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1663 microversion: 2.20 time: 0.313980 Feb 08 16:51:24.296571 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 586/1164] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:23 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1663 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:51:24.313349 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b90b516f-04aa-404f-a622-504685d00272 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f904cc7-1a9b-40be-9650-7ac9357525d4"}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:51:24.314371 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-b90b516f-04aa-404f-a622-504685d00272 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:24.320390 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b90b516f-04aa-404f-a622-504685d00272 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:24.320838 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b90b516f-04aa-404f-a622-504685d00272 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:24.321618 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b90b516f-04aa-404f-a622-504685d00272 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:24.322051 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b90b516f-04aa-404f-a622-504685d00272 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:24.580928 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-b90b516f-04aa-404f-a622-504685d00272 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "POST /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.271657 Feb 08 16:51:24.581623 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 579/1165] 10.222.0.35 () {62 vars in 1363 bytes} [Tue Feb 8 16:51:24 2022] POST /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e/os-volume_attachments => generated 188 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 08 16:51:24.698130 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-086c3ec0-3b97-4531-b05d-f5b884ebeffc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:24.698713 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-086c3ec0-3b97-4531-b05d-f5b884ebeffc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:24.705795 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-086c3ec0-3b97-4531-b05d-f5b884ebeffc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:24.706247 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-086c3ec0-3b97-4531-b05d-f5b884ebeffc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:24.707044 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-086c3ec0-3b97-4531-b05d-f5b884ebeffc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:24.707480 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-086c3ec0-3b97-4531-b05d-f5b884ebeffc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:24.966141 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-086c3ec0-3b97-4531-b05d-f5b884ebeffc tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "DELETE /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e/os-volume_attachments/4f904cc7-1a9b-40be-9650-7ac9357525d4" status: 202 len: 0 microversion: 2.20 time: 0.271774 Feb 08 16:51:24.966924 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 587/1166] 10.222.0.35 () {60 vars in 1456 bytes} [Tue Feb 8 16:51:24 2022] DELETE /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e/os-volume_attachments/4f904cc7-1a9b-40be-9650-7ac9357525d4 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 08 16:51:25.025349 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-bad1941d-849f-4846-8237-0a0a7effe6a7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:51:25.025894 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-bad1941d-849f-4846-8237-0a0a7effe6a7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:25.032604 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bad1941d-849f-4846-8237-0a0a7effe6a7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:25.033060 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bad1941d-849f-4846-8237-0a0a7effe6a7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:25.033863 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bad1941d-849f-4846-8237-0a0a7effe6a7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:25.034311 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bad1941d-849f-4846-8237-0a0a7effe6a7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:25.118456 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-bad1941d-849f-4846-8237-0a0a7effe6a7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "POST /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e/action" status: 202 len: 0 microversion: 2.20 time: 0.096790 Feb 08 16:51:25.119484 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 580/1167] 10.222.0.35 () {62 vars in 1318 bytes} [Tue Feb 8 16:51:25 2022] POST /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 08 16:51:25.129889 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-d436a8d8-4ad6-4376-b8b2-94e3e0a4f5bd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:25.130613 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-d436a8d8-4ad6-4376-b8b2-94e3e0a4f5bd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:25.138459 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d436a8d8-4ad6-4376-b8b2-94e3e0a4f5bd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:25.139375 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d436a8d8-4ad6-4376-b8b2-94e3e0a4f5bd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:25.140410 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d436a8d8-4ad6-4376-b8b2-94e3e0a4f5bd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:25.141015 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-d436a8d8-4ad6-4376-b8b2-94e3e0a4f5bd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:25.147311 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-cc521d2e-7a26-4386-a11d-5b2bbc1bae47 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:25.148498 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-cc521d2e-7a26-4386-a11d-5b2bbc1bae47 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:25.163384 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cc521d2e-7a26-4386-a11d-5b2bbc1bae47 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:25.163909 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cc521d2e-7a26-4386-a11d-5b2bbc1bae47 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:25.165801 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cc521d2e-7a26-4386-a11d-5b2bbc1bae47 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:25.166249 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cc521d2e-7a26-4386-a11d-5b2bbc1bae47 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:25.414491 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-cc521d2e-7a26-4386-a11d-5b2bbc1bae47 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:25.429269 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-cc521d2e-7a26-4386-a11d-5b2bbc1bae47 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b" status: 200 len: 1672 microversion: 2.1 time: 0.295238 Feb 08 16:51:25.430149 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 581/1168] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:25 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b => generated 1672 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:51:25.446129 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-d436a8d8-4ad6-4376-b8b2-94e3e0a4f5bd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:25.455333 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-d436a8d8-4ad6-4376-b8b2-94e3e0a4f5bd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:25.457308 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-d436a8d8-4ad6-4376-b8b2-94e3e0a4f5bd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:25.458570 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-d436a8d8-4ad6-4376-b8b2-94e3e0a4f5bd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1671 microversion: 2.20 time: 0.333725 Feb 08 16:51:25.459306 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 588/1169] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:25 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1671 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:51:25.552401 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-4b63c1f4-ec8c-4d71-b617-6c00be2ec6f7 req-c86f700c-7020-47b5-b7ca-d07a1ba73c3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37885d5b-9597-417c-9d29-bd637383943d", "tag": "27712d05-cbfb-45c1-a1bc-a52d3f0584e7"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:51:25.553954 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:51:25.553954 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:51:25.562920 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-4b63c1f4-ec8c-4d71-b617-6c00be2ec6f7 req-c86f700c-7020-47b5-b7ca-d07a1ba73c3e service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:25.563374 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-4b63c1f4-ec8c-4d71-b617-6c00be2ec6f7 req-c86f700c-7020-47b5-b7ca-d07a1ba73c3e service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:25.574820 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-4b63c1f4-ec8c-4d71-b617-6c00be2ec6f7 req-c86f700c-7020-47b5-b7ca-d07a1ba73c3e service nova] Creating event network-changed:27712d05-cbfb-45c1-a1bc-a52d3f0584e7 for instance 37885d5b-9597-417c-9d29-bd637383943d on hv-cinder-82786 Feb 08 16:51:25.579910 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-4b63c1f4-ec8c-4d71-b617-6c00be2ec6f7 req-c86f700c-7020-47b5-b7ca-d07a1ba73c3e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030971 Feb 08 16:51:25.580721 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 582/1170] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:51:26.409546 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-3ca8a386-d63e-4cae-8191-e1c0fa262656 req-e9194c94-469d-420f-8427-e76ef92fa58e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69ba823-eca2-461c-849e-746060cb934b", "name": "network-vif-deleted", "tag": "dc24f391-2e36-414a-9320-975414f69f4f"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:51:26.411698 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:51:26.411698 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:51:26.419546 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-3ca8a386-d63e-4cae-8191-e1c0fa262656 req-e9194c94-469d-420f-8427-e76ef92fa58e service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:26.420327 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-3ca8a386-d63e-4cae-8191-e1c0fa262656 req-e9194c94-469d-420f-8427-e76ef92fa58e service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:26.431432 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-3ca8a386-d63e-4cae-8191-e1c0fa262656 req-e9194c94-469d-420f-8427-e76ef92fa58e service nova] Creating event network-vif-deleted:dc24f391-2e36-414a-9320-975414f69f4f for instance b69ba823-eca2-461c-849e-746060cb934b on hv-cinder-82786 Feb 08 16:51:26.438707 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-3ca8a386-d63e-4cae-8191-e1c0fa262656 req-e9194c94-469d-420f-8427-e76ef92fa58e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032526 Feb 08 16:51:26.442728 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 589/1171] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:51:26.453670 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-28a8897a-0503-40f2-9e35-2e0f60564bd1 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:26.455571 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-28a8897a-0503-40f2-9e35-2e0f60564bd1 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:26.465784 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-28a8897a-0503-40f2-9e35-2e0f60564bd1 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:26.466831 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-28a8897a-0503-40f2-9e35-2e0f60564bd1 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:26.468153 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-28a8897a-0503-40f2-9e35-2e0f60564bd1 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:26.468856 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-28a8897a-0503-40f2-9e35-2e0f60564bd1 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:26.477727 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-86027576-ee7f-4715-b668-cb1f678943a2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:26.478435 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-86027576-ee7f-4715-b668-cb1f678943a2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:26.487948 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-86027576-ee7f-4715-b668-cb1f678943a2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:26.493207 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-86027576-ee7f-4715-b668-cb1f678943a2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:26.496505 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-86027576-ee7f-4715-b668-cb1f678943a2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:26.497097 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-86027576-ee7f-4715-b668-cb1f678943a2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:26.550177 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-28a8897a-0503-40f2-9e35-2e0f60564bd1 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5f36415ea7148d79f9fdb9cfac129e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2214758b43e6434b8c27d97f7fd1151c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:26.560196 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-28a8897a-0503-40f2-9e35-2e0f60564bd1 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b" status: 200 len: 1321 microversion: 2.1 time: 0.114608 Feb 08 16:51:26.560941 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 583/1172] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:26 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b => generated 1321 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:51:26.701178 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-86027576-ee7f-4715-b668-cb1f678943a2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:26.710426 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-86027576-ee7f-4715-b668-cb1f678943a2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:26.712376 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-86027576-ee7f-4715-b668-cb1f678943a2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:26.713526 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-86027576-ee7f-4715-b668-cb1f678943a2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1729 microversion: 2.20 time: 0.240724 Feb 08 16:51:26.714095 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 590/1173] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:26 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1729 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:51:27.576541 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ef9b9c4b-b8e7-4600-b350-15e3134dff2d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:27.577150 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-ef9b9c4b-b8e7-4600-b350-15e3134dff2d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:27.584012 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ef9b9c4b-b8e7-4600-b350-15e3134dff2d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:27.584466 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ef9b9c4b-b8e7-4600-b350-15e3134dff2d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:27.585243 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ef9b9c4b-b8e7-4600-b350-15e3134dff2d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:27.585674 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ef9b9c4b-b8e7-4600-b350-15e3134dff2d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:27.601888 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.wsgi [None req-ef9b9c4b-b8e7-4600-b350-15e3134dff2d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] HTTP exception thrown: Instance b69ba823-eca2-461c-849e-746060cb934b could not be found. Feb 08 16:51:27.602524 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ef9b9c4b-b8e7-4600-b350-15e3134dff2d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Returning 404 to user: Instance b69ba823-eca2-461c-849e-746060cb934b could not be found. {{(pid=122901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:51:27.603341 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-ef9b9c4b-b8e7-4600-b350-15e3134dff2d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b" status: 404 len: 111 microversion: 2.1 time: 0.030428 Feb 08 16:51:27.608551 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 584/1174] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:27 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:51:27.614351 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-60cb7430-15bd-48f5-b2bb-e1d1e0716cca tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '.version_select at 0x7fcde0194040>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:27.675051 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-60cb7430-15bd-48f5-b2bb-e1d1e0716cca tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1496228144" status: 202 len: 0 microversion: 2.1 time: 0.064723 Feb 08 16:51:27.675791 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 591/1175] 10.222.0.35 () {58 vars in 1220 bytes} [Tue Feb 8 16:51:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1496228144 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:51:27.734434 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-db3913b9-af4f-418d-ac01-f8e305cb5cb9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:27.734962 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-db3913b9-af4f-418d-ac01-f8e305cb5cb9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:27.748792 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-db3913b9-af4f-418d-ac01-f8e305cb5cb9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:27.749291 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-db3913b9-af4f-418d-ac01-f8e305cb5cb9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:27.751844 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-db3913b9-af4f-418d-ac01-f8e305cb5cb9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:27.752333 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-db3913b9-af4f-418d-ac01-f8e305cb5cb9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:28.078878 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-db3913b9-af4f-418d-ac01-f8e305cb5cb9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:28.091433 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-db3913b9-af4f-418d-ac01-f8e305cb5cb9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:28.096085 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-db3913b9-af4f-418d-ac01-f8e305cb5cb9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:28.098265 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-db3913b9-af4f-418d-ac01-f8e305cb5cb9 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1729 microversion: 2.20 time: 0.369138 Feb 08 16:51:28.100802 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 585/1176] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:27 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1729 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:29.121014 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-dc852007-8fee-4be4-93f5-14bb52b11f39 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:29.121814 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-dc852007-8fee-4be4-93f5-14bb52b11f39 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:29.129798 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dc852007-8fee-4be4-93f5-14bb52b11f39 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:29.130624 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dc852007-8fee-4be4-93f5-14bb52b11f39 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:29.131882 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dc852007-8fee-4be4-93f5-14bb52b11f39 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:29.132798 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dc852007-8fee-4be4-93f5-14bb52b11f39 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:29.294819 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-dc852007-8fee-4be4-93f5-14bb52b11f39 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:29.303315 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-dc852007-8fee-4be4-93f5-14bb52b11f39 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:29.305109 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-dc852007-8fee-4be4-93f5-14bb52b11f39 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:29.306281 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-dc852007-8fee-4be4-93f5-14bb52b11f39 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1729 microversion: 2.20 time: 0.191364 Feb 08 16:51:29.316081 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 592/1177] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:29 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1729 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:30.325045 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-4c008f26-6e75-4373-a207-0c8913378343 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:30.326462 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4c008f26-6e75-4373-a207-0c8913378343 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:30.333006 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4c008f26-6e75-4373-a207-0c8913378343 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:30.333961 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4c008f26-6e75-4373-a207-0c8913378343 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:30.335044 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4c008f26-6e75-4373-a207-0c8913378343 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:30.335686 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4c008f26-6e75-4373-a207-0c8913378343 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:30.490626 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4c008f26-6e75-4373-a207-0c8913378343 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:30.508111 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4c008f26-6e75-4373-a207-0c8913378343 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:30.510933 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4c008f26-6e75-4373-a207-0c8913378343 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:30.512994 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-4c008f26-6e75-4373-a207-0c8913378343 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1729 microversion: 2.20 time: 0.191889 Feb 08 16:51:30.513954 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 586/1178] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:30 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:30.980389 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-705348d3-5579-473a-8c74-9cdd92a61d7d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:30.981478 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-705348d3-5579-473a-8c74-9cdd92a61d7d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:30.989382 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-705348d3-5579-473a-8c74-9cdd92a61d7d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:30.990104 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-705348d3-5579-473a-8c74-9cdd92a61d7d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:30.991221 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-705348d3-5579-473a-8c74-9cdd92a61d7d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:30.992026 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-705348d3-5579-473a-8c74-9cdd92a61d7d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:31.006677 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-705348d3-5579-473a-8c74-9cdd92a61d7d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] HTTP exception thrown: Instance b69ba823-eca2-461c-849e-746060cb934b could not be found. Feb 08 16:51:31.007288 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-705348d3-5579-473a-8c74-9cdd92a61d7d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Returning 404 to user: Instance b69ba823-eca2-461c-849e-746060cb934b could not be found. {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:51:31.008168 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-705348d3-5579-473a-8c74-9cdd92a61d7d tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b" status: 404 len: 111 microversion: 2.1 time: 0.033262 Feb 08 16:51:31.008725 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 593/1179] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Feb 8 16:51:30 2022] DELETE /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 08 16:51:31.018001 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-0a6aca84-8090-4fe2-b646-792cddafd95e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:31.018643 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-0a6aca84-8090-4fe2-b646-792cddafd95e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: b69ba823-eca2-461c-849e-746060cb934b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:31.026157 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0a6aca84-8090-4fe2-b646-792cddafd95e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:31.026615 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0a6aca84-8090-4fe2-b646-792cddafd95e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:31.028228 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0a6aca84-8090-4fe2-b646-792cddafd95e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:31.028682 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-0a6aca84-8090-4fe2-b646-792cddafd95e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:31.042345 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.wsgi [None req-0a6aca84-8090-4fe2-b646-792cddafd95e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] HTTP exception thrown: Instance b69ba823-eca2-461c-849e-746060cb934b could not be found. Feb 08 16:51:31.043498 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-0a6aca84-8090-4fe2-b646-792cddafd95e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Returning 404 to user: Instance b69ba823-eca2-461c-849e-746060cb934b could not be found. {{(pid=122901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:51:31.044303 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-0a6aca84-8090-4fe2-b646-792cddafd95e tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b" status: 404 len: 111 microversion: 2.1 time: 0.030474 Feb 08 16:51:31.045040 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 587/1180] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:31 2022] GET /compute/v2.1/servers/b69ba823-eca2-461c-849e-746060cb934b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:51:31.532231 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-56d548b7-0f0e-4595-9ceb-370b94231bfa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:31.532852 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-56d548b7-0f0e-4595-9ceb-370b94231bfa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:31.541842 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-56d548b7-0f0e-4595-9ceb-370b94231bfa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:31.542378 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-56d548b7-0f0e-4595-9ceb-370b94231bfa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:31.543362 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-56d548b7-0f0e-4595-9ceb-370b94231bfa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:31.544035 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-56d548b7-0f0e-4595-9ceb-370b94231bfa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:31.698069 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-56d548b7-0f0e-4595-9ceb-370b94231bfa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:31.707741 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-56d548b7-0f0e-4595-9ceb-370b94231bfa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:31.709446 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-56d548b7-0f0e-4595-9ceb-370b94231bfa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:31.710625 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-56d548b7-0f0e-4595-9ceb-370b94231bfa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1729 microversion: 2.20 time: 0.182101 Feb 08 16:51:31.711182 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 594/1181] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:31 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:32.190263 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-336a5f91-8afa-4e65-92a3-059474d342a4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:32.190836 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-336a5f91-8afa-4e65-92a3-059474d342a4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:32.198080 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-336a5f91-8afa-4e65-92a3-059474d342a4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:32.198617 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-336a5f91-8afa-4e65-92a3-059474d342a4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:32.200129 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-336a5f91-8afa-4e65-92a3-059474d342a4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:32.200899 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-336a5f91-8afa-4e65-92a3-059474d342a4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:32.215173 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.wsgi [None req-336a5f91-8afa-4e65-92a3-059474d342a4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] HTTP exception thrown: Instance 136b1df1-a111-4a7b-8a8d-5e095dadc764 could not be found. Feb 08 16:51:32.215985 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-336a5f91-8afa-4e65-92a3-059474d342a4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Returning 404 to user: Instance 136b1df1-a111-4a7b-8a8d-5e095dadc764 could not be found. {{(pid=122901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:51:32.216898 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-336a5f91-8afa-4e65-92a3-059474d342a4 tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "DELETE /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 404 len: 111 microversion: 2.1 time: 0.030475 Feb 08 16:51:32.217521 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 588/1182] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Feb 8 16:51:32 2022] DELETE /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:51:32.244287 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-82a5b958-9d71-4955-be20-5b8cdfc7228b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:32.245039 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-82a5b958-9d71-4955-be20-5b8cdfc7228b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] [instance: 136b1df1-a111-4a7b-8a8d-5e095dadc764] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:32.252907 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-82a5b958-9d71-4955-be20-5b8cdfc7228b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:32.253639 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-82a5b958-9d71-4955-be20-5b8cdfc7228b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:32.254626 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-82a5b958-9d71-4955-be20-5b8cdfc7228b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:32.255243 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-82a5b958-9d71-4955-be20-5b8cdfc7228b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:32.269804 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-82a5b958-9d71-4955-be20-5b8cdfc7228b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] HTTP exception thrown: Instance 136b1df1-a111-4a7b-8a8d-5e095dadc764 could not be found. Feb 08 16:51:32.270408 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-82a5b958-9d71-4955-be20-5b8cdfc7228b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] Returning 404 to user: Instance 136b1df1-a111-4a7b-8a8d-5e095dadc764 could not be found. {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:51:32.271287 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-82a5b958-9d71-4955-be20-5b8cdfc7228b tempest-AttachVolumeTestJSON-1905206352 tempest-AttachVolumeTestJSON-1905206352-project] 10.222.0.35 "GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764" status: 404 len: 111 microversion: 2.1 time: 0.048933 Feb 08 16:51:32.271890 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 595/1183] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:51:32 2022] GET /compute/v2.1/servers/136b1df1-a111-4a7b-8a8d-5e095dadc764 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 08 16:51:32.729293 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-c982aadc-d882-4c05-8711-b6d34e167e46 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:32.730809 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-c982aadc-d882-4c05-8711-b6d34e167e46 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:32.738027 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c982aadc-d882-4c05-8711-b6d34e167e46 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:32.739004 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c982aadc-d882-4c05-8711-b6d34e167e46 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:32.740106 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c982aadc-d882-4c05-8711-b6d34e167e46 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:32.740780 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c982aadc-d882-4c05-8711-b6d34e167e46 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:33.010577 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c982aadc-d882-4c05-8711-b6d34e167e46 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:33.025586 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c982aadc-d882-4c05-8711-b6d34e167e46 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:33.027293 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c982aadc-d882-4c05-8711-b6d34e167e46 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:33.029344 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-c982aadc-d882-4c05-8711-b6d34e167e46 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1729 microversion: 2.20 time: 0.303799 Feb 08 16:51:33.030371 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 589/1184] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:32 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1729 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:34.052038 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-030f24be-1df4-45ab-bc22-f8248b83286c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:34.053364 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-030f24be-1df4-45ab-bc22-f8248b83286c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:34.061271 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-030f24be-1df4-45ab-bc22-f8248b83286c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:34.061994 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-030f24be-1df4-45ab-bc22-f8248b83286c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:34.062986 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-030f24be-1df4-45ab-bc22-f8248b83286c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:34.063432 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-030f24be-1df4-45ab-bc22-f8248b83286c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:34.475730 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-030f24be-1df4-45ab-bc22-f8248b83286c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:34.494522 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-030f24be-1df4-45ab-bc22-f8248b83286c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:34.496699 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-030f24be-1df4-45ab-bc22-f8248b83286c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:34.498819 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-030f24be-1df4-45ab-bc22-f8248b83286c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1729 microversion: 2.20 time: 0.456293 Feb 08 16:51:34.499390 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 596/1185] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:34 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1729 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:35.517564 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-d393eb3b-ac82-4508-bcf3-a07effefedc2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:35.519213 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-d393eb3b-ac82-4508-bcf3-a07effefedc2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:35.526418 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d393eb3b-ac82-4508-bcf3-a07effefedc2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:35.527865 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d393eb3b-ac82-4508-bcf3-a07effefedc2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:35.528939 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d393eb3b-ac82-4508-bcf3-a07effefedc2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:35.529452 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-d393eb3b-ac82-4508-bcf3-a07effefedc2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:35.757353 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d393eb3b-ac82-4508-bcf3-a07effefedc2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:35.767094 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d393eb3b-ac82-4508-bcf3-a07effefedc2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:35.775476 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-d393eb3b-ac82-4508-bcf3-a07effefedc2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:35.776943 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-d393eb3b-ac82-4508-bcf3-a07effefedc2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1729 microversion: 2.20 time: 0.263261 Feb 08 16:51:35.788021 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 590/1186] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:35 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1729 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:36.798453 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-81056b27-2ca2-46f2-932c-3c49bd7968c2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:36.799063 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-81056b27-2ca2-46f2-932c-3c49bd7968c2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:36.805341 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-81056b27-2ca2-46f2-932c-3c49bd7968c2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:36.805796 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-81056b27-2ca2-46f2-932c-3c49bd7968c2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:36.806576 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-81056b27-2ca2-46f2-932c-3c49bd7968c2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:36.807017 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-81056b27-2ca2-46f2-932c-3c49bd7968c2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:36.954630 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-81056b27-2ca2-46f2-932c-3c49bd7968c2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:36.962430 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-81056b27-2ca2-46f2-932c-3c49bd7968c2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:36.964003 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-81056b27-2ca2-46f2-932c-3c49bd7968c2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:36.965342 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-81056b27-2ca2-46f2-932c-3c49bd7968c2 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1729 microversion: 2.20 time: 0.170501 Feb 08 16:51:36.965898 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 597/1187] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:36 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:37.983142 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b96ded50-96cd-487c-935d-9111682707b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:37.983777 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-b96ded50-96cd-487c-935d-9111682707b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:37.990018 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b96ded50-96cd-487c-935d-9111682707b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:37.990479 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b96ded50-96cd-487c-935d-9111682707b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:37.991267 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b96ded50-96cd-487c-935d-9111682707b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:37.991709 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b96ded50-96cd-487c-935d-9111682707b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:38.135099 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-b96ded50-96cd-487c-935d-9111682707b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:38.143843 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-b96ded50-96cd-487c-935d-9111682707b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:38.145320 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-b96ded50-96cd-487c-935d-9111682707b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:38.146489 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-b96ded50-96cd-487c-935d-9111682707b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1729 microversion: 2.20 time: 0.167303 Feb 08 16:51:38.147040 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 591/1188] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:37 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:39.164553 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-a44cc614-f9ae-4578-ab5e-04c7919cc7ca tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:39.165256 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-a44cc614-f9ae-4578-ab5e-04c7919cc7ca tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:39.172542 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a44cc614-f9ae-4578-ab5e-04c7919cc7ca tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:39.173069 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a44cc614-f9ae-4578-ab5e-04c7919cc7ca tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:39.173946 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a44cc614-f9ae-4578-ab5e-04c7919cc7ca tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:39.174456 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a44cc614-f9ae-4578-ab5e-04c7919cc7ca tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:39.313932 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-a44cc614-f9ae-4578-ab5e-04c7919cc7ca tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:39.322269 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-a44cc614-f9ae-4578-ab5e-04c7919cc7ca tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:39.324025 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-a44cc614-f9ae-4578-ab5e-04c7919cc7ca tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:39.325153 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-a44cc614-f9ae-4578-ab5e-04c7919cc7ca tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1729 microversion: 2.20 time: 0.164308 Feb 08 16:51:39.325713 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 598/1189] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:39 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:40.343696 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-633cbde1-c55d-498c-968e-0a4b53e99594 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:40.344348 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-633cbde1-c55d-498c-968e-0a4b53e99594 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:40.350266 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-633cbde1-c55d-498c-968e-0a4b53e99594 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:40.350721 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-633cbde1-c55d-498c-968e-0a4b53e99594 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:40.351503 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-633cbde1-c55d-498c-968e-0a4b53e99594 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:40.351966 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-633cbde1-c55d-498c-968e-0a4b53e99594 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:40.501836 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-633cbde1-c55d-498c-968e-0a4b53e99594 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:40.518406 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-633cbde1-c55d-498c-968e-0a4b53e99594 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:40.522741 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-633cbde1-c55d-498c-968e-0a4b53e99594 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:40.524541 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-633cbde1-c55d-498c-968e-0a4b53e99594 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1729 microversion: 2.20 time: 0.184805 Feb 08 16:51:40.525636 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 592/1190] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:40 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:41.561091 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-aacb6c40-3ec8-4208-b96e-cac86fb2dafa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:41.561740 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-aacb6c40-3ec8-4208-b96e-cac86fb2dafa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:41.568026 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-aacb6c40-3ec8-4208-b96e-cac86fb2dafa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:41.568423 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-aacb6c40-3ec8-4208-b96e-cac86fb2dafa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:41.569201 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-aacb6c40-3ec8-4208-b96e-cac86fb2dafa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:41.569643 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-aacb6c40-3ec8-4208-b96e-cac86fb2dafa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:41.701705 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-aacb6c40-3ec8-4208-b96e-cac86fb2dafa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:41.709746 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-aacb6c40-3ec8-4208-b96e-cac86fb2dafa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:41.711260 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-aacb6c40-3ec8-4208-b96e-cac86fb2dafa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:41.712454 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-aacb6c40-3ec8-4208-b96e-cac86fb2dafa tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1729 microversion: 2.20 time: 0.155969 Feb 08 16:51:41.713031 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 599/1191] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:41 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:42.924469 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-f1fc5d8f-92c5-4a6b-a16b-25ac1c1272b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:42.925571 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-f1fc5d8f-92c5-4a6b-a16b-25ac1c1272b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:42.935818 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f1fc5d8f-92c5-4a6b-a16b-25ac1c1272b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:42.936336 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f1fc5d8f-92c5-4a6b-a16b-25ac1c1272b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:42.937249 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f1fc5d8f-92c5-4a6b-a16b-25ac1c1272b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:42.937984 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f1fc5d8f-92c5-4a6b-a16b-25ac1c1272b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:43.078178 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f1fc5d8f-92c5-4a6b-a16b-25ac1c1272b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:43.086216 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f1fc5d8f-92c5-4a6b-a16b-25ac1c1272b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:43.087804 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f1fc5d8f-92c5-4a6b-a16b-25ac1c1272b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:43.089398 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-f1fc5d8f-92c5-4a6b-a16b-25ac1c1272b8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1729 microversion: 2.20 time: 0.362785 Feb 08 16:51:43.090526 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 593/1192] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:42 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1729 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:43.841994 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-bf4a9ed9-f702-4811-912f-7516bc7b2851 req-cd021d2a-6ad0-4c5c-833b-424b4101ee95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a6041b-b9e3-4224-b52e-265ff88bb57e", "name": "network-vif-plugged", "status": "completed", "tag": "a1385bb4-6242-43a5-80b9-5e5963fd66f2"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:51:43.844268 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:51:43.844268 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:51:43.852428 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-bf4a9ed9-f702-4811-912f-7516bc7b2851 req-cd021d2a-6ad0-4c5c-833b-424b4101ee95 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:43.852875 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-bf4a9ed9-f702-4811-912f-7516bc7b2851 req-cd021d2a-6ad0-4c5c-833b-424b4101ee95 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:43.865192 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-bf4a9ed9-f702-4811-912f-7516bc7b2851 req-cd021d2a-6ad0-4c5c-833b-424b4101ee95 service nova] Creating event network-vif-plugged:a1385bb4-6242-43a5-80b9-5e5963fd66f2 for instance 71a6041b-b9e3-4224-b52e-265ff88bb57e on hv-cinder-82786 Feb 08 16:51:43.870778 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-bf4a9ed9-f702-4811-912f-7516bc7b2851 req-cd021d2a-6ad0-4c5c-833b-424b4101ee95 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032991 Feb 08 16:51:43.872167 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 600/1193] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:51:44.118372 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-a304b469-8c1b-4863-a072-131718ef55de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:44.119745 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-a304b469-8c1b-4863-a072-131718ef55de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:44.128151 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a304b469-8c1b-4863-a072-131718ef55de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:44.129781 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a304b469-8c1b-4863-a072-131718ef55de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:44.130831 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a304b469-8c1b-4863-a072-131718ef55de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:44.131289 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a304b469-8c1b-4863-a072-131718ef55de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:44.283067 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-a304b469-8c1b-4863-a072-131718ef55de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:44.291287 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-a304b469-8c1b-4863-a072-131718ef55de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:44.292991 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-a304b469-8c1b-4863-a072-131718ef55de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:44.294834 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-a304b469-8c1b-4863-a072-131718ef55de tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1729 microversion: 2.20 time: 0.183648 Feb 08 16:51:44.295386 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 594/1194] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:44 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 08 16:51:45.313676 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-3738d524-9cea-4203-9d62-1aa9d83ba212 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:45.314551 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-3738d524-9cea-4203-9d62-1aa9d83ba212 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:45.321009 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3738d524-9cea-4203-9d62-1aa9d83ba212 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:45.321797 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3738d524-9cea-4203-9d62-1aa9d83ba212 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:45.322592 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3738d524-9cea-4203-9d62-1aa9d83ba212 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:45.323035 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3738d524-9cea-4203-9d62-1aa9d83ba212 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:45.466163 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3738d524-9cea-4203-9d62-1aa9d83ba212 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:45.474581 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3738d524-9cea-4203-9d62-1aa9d83ba212 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:45.477001 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3738d524-9cea-4203-9d62-1aa9d83ba212 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:45.478190 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-3738d524-9cea-4203-9d62-1aa9d83ba212 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1729 microversion: 2.20 time: 0.169251 Feb 08 16:51:45.478746 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 601/1195] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:45 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:51:46.498215 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-3cea36e0-d34a-4fb5-a036-d15f50a27ec7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:51:46.498825 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-3cea36e0-d34a-4fb5-a036-d15f50a27ec7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:51:46.505531 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3cea36e0-d34a-4fb5-a036-d15f50a27ec7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:46.505666 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3cea36e0-d34a-4fb5-a036-d15f50a27ec7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:46.506377 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3cea36e0-d34a-4fb5-a036-d15f50a27ec7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:51:46.506767 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-3cea36e0-d34a-4fb5-a036-d15f50a27ec7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:51:46.654911 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-3cea36e0-d34a-4fb5-a036-d15f50a27ec7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:46.663362 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-3cea36e0-d34a-4fb5-a036-d15f50a27ec7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:46.664907 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-3cea36e0-d34a-4fb5-a036-d15f50a27ec7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:51:46.666015 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-3cea36e0-d34a-4fb5-a036-d15f50a27ec7 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1716 microversion: 2.20 time: 0.172741 Feb 08 16:51:46.666578 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 595/1196] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:51:46 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1716 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:52:56.852929 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-b21cc438-0766-46f2-8960-bf2146a99336 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:52:56.853845 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-b21cc438-0766-46f2-8960-bf2146a99336 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:52:56.859661 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b21cc438-0766-46f2-8960-bf2146a99336 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:52:56.860221 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b21cc438-0766-46f2-8960-bf2146a99336 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:52:56.861004 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b21cc438-0766-46f2-8960-bf2146a99336 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:52:56.861445 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-b21cc438-0766-46f2-8960-bf2146a99336 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:52:56.889827 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-b21cc438-0766-46f2-8960-bf2146a99336 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041955 Feb 08 16:52:56.890377 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 602/1197] 10.222.0.35 () {60 vars in 1342 bytes} [Tue Feb 8 16:52:56 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:52:56.946658 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-811fc1ca-eaba-41cb-b592-c339c6617615 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:52:56.947198 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-811fc1ca-eaba-41cb-b592-c339c6617615 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:52:56.953203 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-811fc1ca-eaba-41cb-b592-c339c6617615 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:52:56.953658 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-811fc1ca-eaba-41cb-b592-c339c6617615 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:52:56.954475 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-811fc1ca-eaba-41cb-b592-c339c6617615 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:52:56.954916 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-811fc1ca-eaba-41cb-b592-c339c6617615 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:52:56.979628 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-811fc1ca-eaba-41cb-b592-c339c6617615 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Going to try to terminate instance {{(pid=122901) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 16:52:57.054788 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-811fc1ca-eaba-41cb-b592-c339c6617615 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "DELETE /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 204 len: 0 microversion: 2.20 time: 0.112973 Feb 08 16:52:57.055299 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 596/1198] 10.222.0.35 () {60 vars in 1279 bytes} [Tue Feb 8 16:52:56 2022] DELETE /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 08 16:52:57.063600 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-2336cd49-8599-4b77-a599-74eaaee7366c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:52:57.064246 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-2336cd49-8599-4b77-a599-74eaaee7366c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:52:57.070283 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2336cd49-8599-4b77-a599-74eaaee7366c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:52:57.070758 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2336cd49-8599-4b77-a599-74eaaee7366c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:52:57.071531 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2336cd49-8599-4b77-a599-74eaaee7366c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:52:57.072003 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2336cd49-8599-4b77-a599-74eaaee7366c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:52:57.202307 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-2336cd49-8599-4b77-a599-74eaaee7366c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:52:57.210639 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-2336cd49-8599-4b77-a599-74eaaee7366c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:52:57.212173 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-2336cd49-8599-4b77-a599-74eaaee7366c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:52:57.213337 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-2336cd49-8599-4b77-a599-74eaaee7366c tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1722 microversion: 2.20 time: 0.153695 Feb 08 16:52:57.213894 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 603/1199] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:52:57 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:52:58.233970 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-8f98c94c-e7f5-428a-a3c7-1b96ffcae40f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:52:58.234674 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-8f98c94c-e7f5-428a-a3c7-1b96ffcae40f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:52:58.241815 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8f98c94c-e7f5-428a-a3c7-1b96ffcae40f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:52:58.242279 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8f98c94c-e7f5-428a-a3c7-1b96ffcae40f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:52:58.243316 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8f98c94c-e7f5-428a-a3c7-1b96ffcae40f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:52:58.243490 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-8f98c94c-e7f5-428a-a3c7-1b96ffcae40f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:52:58.387692 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-8f98c94c-e7f5-428a-a3c7-1b96ffcae40f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:52:58.395558 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-8f98c94c-e7f5-428a-a3c7-1b96ffcae40f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:52:58.397103 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-8f98c94c-e7f5-428a-a3c7-1b96ffcae40f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:52:58.398273 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-8f98c94c-e7f5-428a-a3c7-1b96ffcae40f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1722 microversion: 2.20 time: 0.168451 Feb 08 16:52:58.398837 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 597/1200] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:52:58 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:52:59.416518 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c57710eb-41c2-4d2b-9261-ddeea98db161 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:52:59.417133 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c57710eb-41c2-4d2b-9261-ddeea98db161 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:52:59.423657 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c57710eb-41c2-4d2b-9261-ddeea98db161 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:52:59.424262 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c57710eb-41c2-4d2b-9261-ddeea98db161 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:52:59.425059 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c57710eb-41c2-4d2b-9261-ddeea98db161 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:52:59.425505 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c57710eb-41c2-4d2b-9261-ddeea98db161 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:52:59.485831 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c57710eb-41c2-4d2b-9261-ddeea98db161 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:52:59.493590 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c57710eb-41c2-4d2b-9261-ddeea98db161 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:52:59.495087 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c57710eb-41c2-4d2b-9261-ddeea98db161 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c858d129681846aba9e366c37c2213a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23325df6a88748fc9261e22c093ac67e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:52:59.496286 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c57710eb-41c2-4d2b-9261-ddeea98db161 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 200 len: 1655 microversion: 2.20 time: 0.083556 Feb 08 16:52:59.496846 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 604/1201] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:52:59 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 1655 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 08 16:52:59.800810 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-036930d6-da3f-413c-9f94-f20f698b1eb1 req-e3a01f53-7a77-4451-a36c-1847485d5cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a6041b-b9e3-4224-b52e-265ff88bb57e", "name": "network-vif-deleted", "tag": "a1385bb4-6242-43a5-80b9-5e5963fd66f2"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:52:59.802588 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:52:59.802588 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:52:59.809820 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-036930d6-da3f-413c-9f94-f20f698b1eb1 req-e3a01f53-7a77-4451-a36c-1847485d5cd8 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:52:59.810321 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-036930d6-da3f-413c-9f94-f20f698b1eb1 req-e3a01f53-7a77-4451-a36c-1847485d5cd8 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:52:59.822117 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-036930d6-da3f-413c-9f94-f20f698b1eb1 req-e3a01f53-7a77-4451-a36c-1847485d5cd8 service nova] Creating event network-vif-deleted:a1385bb4-6242-43a5-80b9-5e5963fd66f2 for instance 71a6041b-b9e3-4224-b52e-265ff88bb57e on hv-cinder-82786 Feb 08 16:52:59.827313 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-036930d6-da3f-413c-9f94-f20f698b1eb1 req-e3a01f53-7a77-4451-a36c-1847485d5cd8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170979 Feb 08 16:52:59.828716 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 598/1202] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:53:00.514216 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-bbf0f0b9-7d2d-4936-818e-7622f7c5dd21 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:00.514853 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-bbf0f0b9-7d2d-4936-818e-7622f7c5dd21 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:53:00.521995 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bbf0f0b9-7d2d-4936-818e-7622f7c5dd21 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:00.522443 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bbf0f0b9-7d2d-4936-818e-7622f7c5dd21 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:00.523237 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bbf0f0b9-7d2d-4936-818e-7622f7c5dd21 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:00.523669 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-bbf0f0b9-7d2d-4936-818e-7622f7c5dd21 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:00.537875 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-bbf0f0b9-7d2d-4936-818e-7622f7c5dd21 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] HTTP exception thrown: Instance 71a6041b-b9e3-4224-b52e-265ff88bb57e could not be found. Feb 08 16:53:00.538513 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-bbf0f0b9-7d2d-4936-818e-7622f7c5dd21 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Returning 404 to user: Instance 71a6041b-b9e3-4224-b52e-265ff88bb57e could not be found. {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:53:00.539353 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-bbf0f0b9-7d2d-4936-818e-7622f7c5dd21 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 404 len: 111 microversion: 2.20 time: 0.028853 Feb 08 16:53:00.539947 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 605/1203] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:53:00 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 08 16:53:00.549081 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-6985b89c-f868-4b30-9cf1-04af0a04e2bd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '.version_select at 0x7fcde045e280>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:00.569007 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-6985b89c-f868-4b30-9cf1-04af0a04e2bd tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-547000072" status: 204 len: 0 microversion: 2.20 time: 0.023921 Feb 08 16:53:00.569521 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 599/1204] 10.222.0.35 () {60 vars in 1258 bytes} [Tue Feb 8 16:53:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-547000072 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 08 16:53:02.327080 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-87705a99-a37f-439c-b8fa-e4a9dc6b8812 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:02.327720 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-87705a99-a37f-439c-b8fa-e4a9dc6b8812 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:53:02.334151 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-87705a99-a37f-439c-b8fa-e4a9dc6b8812 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:02.334606 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-87705a99-a37f-439c-b8fa-e4a9dc6b8812 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:02.335399 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-87705a99-a37f-439c-b8fa-e4a9dc6b8812 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:02.335867 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-87705a99-a37f-439c-b8fa-e4a9dc6b8812 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:02.350279 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-87705a99-a37f-439c-b8fa-e4a9dc6b8812 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] HTTP exception thrown: Instance 71a6041b-b9e3-4224-b52e-265ff88bb57e could not be found. Feb 08 16:53:02.350803 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-87705a99-a37f-439c-b8fa-e4a9dc6b8812 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Returning 404 to user: Instance 71a6041b-b9e3-4224-b52e-265ff88bb57e could not be found. {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:53:02.351659 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-87705a99-a37f-439c-b8fa-e4a9dc6b8812 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "DELETE /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 404 len: 111 microversion: 2.20 time: 0.028255 Feb 08 16:53:02.352255 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 606/1205] 10.222.0.35 () {60 vars in 1279 bytes} [Tue Feb 8 16:53:02 2022] DELETE /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 08 16:53:02.360827 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-bb1a1b3b-dfb5-4f6d-abe0-92fdd432419e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:02.361705 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-bb1a1b3b-dfb5-4f6d-abe0-92fdd432419e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: 71a6041b-b9e3-4224-b52e-265ff88bb57e] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:53:02.369369 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bb1a1b3b-dfb5-4f6d-abe0-92fdd432419e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:02.369822 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bb1a1b3b-dfb5-4f6d-abe0-92fdd432419e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:02.370617 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bb1a1b3b-dfb5-4f6d-abe0-92fdd432419e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:02.371200 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bb1a1b3b-dfb5-4f6d-abe0-92fdd432419e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:02.387515 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.wsgi [None req-bb1a1b3b-dfb5-4f6d-abe0-92fdd432419e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] HTTP exception thrown: Instance 71a6041b-b9e3-4224-b52e-265ff88bb57e could not be found. Feb 08 16:53:02.388139 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-bb1a1b3b-dfb5-4f6d-abe0-92fdd432419e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Returning 404 to user: Instance 71a6041b-b9e3-4224-b52e-265ff88bb57e could not be found. {{(pid=122901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:53:02.388979 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-bb1a1b3b-dfb5-4f6d-abe0-92fdd432419e tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e" status: 404 len: 111 microversion: 2.20 time: 0.032501 Feb 08 16:53:02.389543 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 600/1206] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:53:02 2022] GET /compute/v2.1/servers/71a6041b-b9e3-4224-b52e-265ff88bb57e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 08 16:53:03.520771 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-5a395319-86f4-4af8-a56f-9423ea43f7e8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:03.521264 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-5a395319-86f4-4af8-a56f-9423ea43f7e8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:53:03.527432 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5a395319-86f4-4af8-a56f-9423ea43f7e8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:03.527913 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5a395319-86f4-4af8-a56f-9423ea43f7e8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:03.528694 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5a395319-86f4-4af8-a56f-9423ea43f7e8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:03.529128 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-5a395319-86f4-4af8-a56f-9423ea43f7e8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:03.542634 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-5a395319-86f4-4af8-a56f-9423ea43f7e8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] HTTP exception thrown: Instance da00c476-8246-413e-889c-d22fe63e2ef8 could not be found. Feb 08 16:53:03.543210 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-5a395319-86f4-4af8-a56f-9423ea43f7e8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Returning 404 to user: Instance da00c476-8246-413e-889c-d22fe63e2ef8 could not be found. {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:53:03.544049 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-5a395319-86f4-4af8-a56f-9423ea43f7e8 tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "DELETE /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 404 len: 111 microversion: 2.20 time: 0.027016 Feb 08 16:53:03.544560 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 607/1207] 10.222.0.35 () {60 vars in 1279 bytes} [Tue Feb 8 16:53:03 2022] DELETE /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 08 16:53:03.553449 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b7f8a3e5-2327-43c5-9343-fae64489ee2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:03.554052 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-b7f8a3e5-2327-43c5-9343-fae64489ee2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] [instance: da00c476-8246-413e-889c-d22fe63e2ef8] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:53:03.560256 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b7f8a3e5-2327-43c5-9343-fae64489ee2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:03.560699 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b7f8a3e5-2327-43c5-9343-fae64489ee2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:03.561519 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b7f8a3e5-2327-43c5-9343-fae64489ee2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:03.561900 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-b7f8a3e5-2327-43c5-9343-fae64489ee2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:03.574852 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.wsgi [None req-b7f8a3e5-2327-43c5-9343-fae64489ee2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] HTTP exception thrown: Instance da00c476-8246-413e-889c-d22fe63e2ef8 could not be found. Feb 08 16:53:03.575427 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-b7f8a3e5-2327-43c5-9343-fae64489ee2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] Returning 404 to user: Instance da00c476-8246-413e-889c-d22fe63e2ef8 could not be found. {{(pid=122901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:53:03.576255 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-b7f8a3e5-2327-43c5-9343-fae64489ee2f tempest-AttachVolumeShelveTestJSON-1926657324 tempest-AttachVolumeShelveTestJSON-1926657324-project] 10.222.0.35 "GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8" status: 404 len: 111 microversion: 2.20 time: 0.027767 Feb 08 16:53:03.576768 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 601/1208] 10.222.0.35 () {60 vars in 1276 bytes} [Tue Feb 8 16:53:03 2022] GET /compute/v2.1/servers/da00c476-8246-413e-889c-d22fe63e2ef8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 08 16:53:07.918654 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-bbbf6107-3f6d-4edc-bbaa-fb96d692ff9e tempest-VolumesGetTestJSON-1203766334 tempest-VolumesGetTestJSON-1203766334-project] Action: 'create', calling method: .version_select at 0x7fcdd3fba3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1454996107", "metadata": {"Type": "work"}}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:53:08.191910 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-bbbf6107-3f6d-4edc-bbaa-fb96d692ff9e tempest-VolumesGetTestJSON-1203766334 tempest-VolumesGetTestJSON-1203766334-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.381837 Feb 08 16:53:08.192534 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 608/1209] 10.222.0.35 () {60 vars in 1155 bytes} [Tue Feb 8 16:53:07 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 383 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 08 16:53:08.203287 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ff910693-8179-44c6-84fb-3592b4a9733c tempest-VolumesGetTestJSON-1203766334 tempest-VolumesGetTestJSON-1203766334-project] Calling method '.version_select at 0x7fcde01e5d30>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:08.259233 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-ff910693-8179-44c6-84fb-3592b4a9733c tempest-VolumesGetTestJSON-1203766334 tempest-VolumesGetTestJSON-1203766334-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/11623e8c-36b7-4884-92b1-df7b63cd305f" status: 200 len: 353 microversion: 2.1 time: 0.059598 Feb 08 16:53:08.260022 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 602/1210] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Feb 8 16:53:08 2022] GET /compute/v2.1/os-volumes/11623e8c-36b7-4884-92b1-df7b63cd305f => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:53:09.272300 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-8c96bc51-618a-45a8-aa77-32302a59cf66 tempest-VolumesGetTestJSON-1203766334 tempest-VolumesGetTestJSON-1203766334-project] Calling method '.version_select at 0x7fcde01c54c0>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:09.319605 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-8c96bc51-618a-45a8-aa77-32302a59cf66 tempest-VolumesGetTestJSON-1203766334 tempest-VolumesGetTestJSON-1203766334-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/11623e8c-36b7-4884-92b1-df7b63cd305f" status: 200 len: 354 microversion: 2.1 time: 0.051523 Feb 08 16:53:09.320230 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 609/1211] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Feb 8 16:53:09 2022] GET /compute/v2.1/os-volumes/11623e8c-36b7-4884-92b1-df7b63cd305f => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:53:09.331037 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-44b217ba-6281-43cd-9664-b5a432b30cea tempest-VolumesGetTestJSON-1203766334 tempest-VolumesGetTestJSON-1203766334-project] Calling method '.version_select at 0x7fcde00ef430>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:09.377572 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-44b217ba-6281-43cd-9664-b5a432b30cea tempest-VolumesGetTestJSON-1203766334 tempest-VolumesGetTestJSON-1203766334-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/11623e8c-36b7-4884-92b1-df7b63cd305f" status: 200 len: 354 microversion: 2.1 time: 0.050526 Feb 08 16:53:09.378131 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 603/1212] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Feb 8 16:53:09 2022] GET /compute/v2.1/os-volumes/11623e8c-36b7-4884-92b1-df7b63cd305f => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:53:09.394206 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-3a41aac6-cb49-4cf6-bbcd-037c4879e0bf tempest-VolumesGetTestJSON-1203766334 tempest-VolumesGetTestJSON-1203766334-project] Calling method '.version_select at 0x7fcde02e13a0>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:09.453145 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-3a41aac6-cb49-4cf6-bbcd-037c4879e0bf tempest-VolumesGetTestJSON-1203766334 tempest-VolumesGetTestJSON-1203766334-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/11623e8c-36b7-4884-92b1-df7b63cd305f" status: 202 len: 0 microversion: 2.1 time: 0.062547 Feb 08 16:53:09.453982 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 610/1213] 10.222.0.35 () {58 vars in 1247 bytes} [Tue Feb 8 16:53:09 2022] DELETE /compute/v2.1/os-volumes/11623e8c-36b7-4884-92b1-df7b63cd305f => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:53:09.463308 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-fb376c29-1941-47c6-a152-5246592a4a23 tempest-VolumesGetTestJSON-1203766334 tempest-VolumesGetTestJSON-1203766334-project] Calling method '.version_select at 0x7fcde0328b80>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:09.510136 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-fb376c29-1941-47c6-a152-5246592a4a23 tempest-VolumesGetTestJSON-1203766334 tempest-VolumesGetTestJSON-1203766334-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/11623e8c-36b7-4884-92b1-df7b63cd305f" status: 200 len: 353 microversion: 2.1 time: 0.051171 Feb 08 16:53:09.510746 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 604/1214] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Feb 8 16:53:09 2022] GET /compute/v2.1/os-volumes/11623e8c-36b7-4884-92b1-df7b63cd305f => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:53:10.522744 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-19a1d38a-158f-4366-9c6f-75d133dd3405 tempest-VolumesGetTestJSON-1203766334 tempest-VolumesGetTestJSON-1203766334-project] Calling method '.version_select at 0x7fcde0d1ddc0>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:10.548962 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-19a1d38a-158f-4366-9c6f-75d133dd3405 tempest-VolumesGetTestJSON-1203766334 tempest-VolumesGetTestJSON-1203766334-project] HTTP exception thrown: Volume 11623e8c-36b7-4884-92b1-df7b63cd305f could not be found. Feb 08 16:53:10.549552 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-19a1d38a-158f-4366-9c6f-75d133dd3405 tempest-VolumesGetTestJSON-1203766334 tempest-VolumesGetTestJSON-1203766334-project] Returning 404 to user: Volume 11623e8c-36b7-4884-92b1-df7b63cd305f could not be found. {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:53:10.550407 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-19a1d38a-158f-4366-9c6f-75d133dd3405 tempest-VolumesGetTestJSON-1203766334 tempest-VolumesGetTestJSON-1203766334-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/11623e8c-36b7-4884-92b1-df7b63cd305f" status: 404 len: 109 microversion: 2.1 time: 0.032669 Feb 08 16:53:10.550935 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 611/1215] 10.222.0.35 () {58 vars in 1244 bytes} [Tue Feb 8 16:53:10 2022] GET /compute/v2.1/os-volumes/11623e8c-36b7-4884-92b1-df7b63cd305f => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:53:46.556779 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-7e45233f-249d-4e5f-b92f-f6af5e456470 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:46.557352 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7e45233f-249d-4e5f-b92f-f6af5e456470 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:53:46.563279 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7e45233f-249d-4e5f-b92f-f6af5e456470 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:46.563734 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7e45233f-249d-4e5f-b92f-f6af5e456470 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:46.564547 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7e45233f-249d-4e5f-b92f-f6af5e456470 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:46.565019 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7e45233f-249d-4e5f-b92f-f6af5e456470 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:46.590175 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7e45233f-249d-4e5f-b92f-f6af5e456470 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Going to try to terminate instance {{(pid=122901) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 16:53:46.663784 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-7e45233f-249d-4e5f-b92f-f6af5e456470 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "DELETE /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 204 len: 0 microversion: 2.1 time: 0.111546 Feb 08 16:53:46.664362 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 605/1216] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Feb 8 16:53:46 2022] DELETE /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 16:53:46.673730 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-19dacd29-875a-4c7a-98c1-788d4ec02896 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:46.674347 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-19dacd29-875a-4c7a-98c1-788d4ec02896 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:53:46.681231 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-19dacd29-875a-4c7a-98c1-788d4ec02896 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:46.681691 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-19dacd29-875a-4c7a-98c1-788d4ec02896 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:46.682481 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-19dacd29-875a-4c7a-98c1-788d4ec02896 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:46.682927 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-19dacd29-875a-4c7a-98c1-788d4ec02896 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:46.831532 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-19dacd29-875a-4c7a-98c1-788d4ec02896 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:53:46.838923 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-19dacd29-875a-4c7a-98c1-788d4ec02896 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 200 len: 1577 microversion: 2.1 time: 0.169943 Feb 08 16:53:46.839489 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 612/1217] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:53:46 2022] GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:53:47.855559 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-c6a56723-6e0b-4623-84af-f2eaf3486114 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:47.856297 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-c6a56723-6e0b-4623-84af-f2eaf3486114 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:53:47.862655 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c6a56723-6e0b-4623-84af-f2eaf3486114 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:47.863104 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c6a56723-6e0b-4623-84af-f2eaf3486114 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:47.863924 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c6a56723-6e0b-4623-84af-f2eaf3486114 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:47.864856 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-c6a56723-6e0b-4623-84af-f2eaf3486114 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:48.002198 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-c6a56723-6e0b-4623-84af-f2eaf3486114 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:53:48.009986 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-c6a56723-6e0b-4623-84af-f2eaf3486114 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 200 len: 1577 microversion: 2.1 time: 0.158593 Feb 08 16:53:48.010556 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 606/1218] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:53:47 2022] GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:53:49.028119 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-3be78806-4058-4029-af64-fa59f76d2c50 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:49.028920 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-3be78806-4058-4029-af64-fa59f76d2c50 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:53:49.036527 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3be78806-4058-4029-af64-fa59f76d2c50 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:49.037061 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3be78806-4058-4029-af64-fa59f76d2c50 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:49.037978 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3be78806-4058-4029-af64-fa59f76d2c50 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:49.039167 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3be78806-4058-4029-af64-fa59f76d2c50 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:49.104788 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-3be78806-4058-4029-af64-fa59f76d2c50 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:53:49.112088 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-3be78806-4058-4029-af64-fa59f76d2c50 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 200 len: 1509 microversion: 2.1 time: 0.088155 Feb 08 16:53:49.112664 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 613/1219] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:53:49 2022] GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 1509 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:53:49.199983 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-c7d49562-98f4-4462-af35-41d9214137ab req-e185ca4a-c555-4cb3-857d-e47787ba255a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37885d5b-9597-417c-9d29-bd637383943d", "name": "network-vif-deleted", "tag": "27712d05-cbfb-45c1-a1bc-a52d3f0584e7"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:53:49.201479 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:53:49.201479 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:53:49.209638 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-c7d49562-98f4-4462-af35-41d9214137ab req-e185ca4a-c555-4cb3-857d-e47787ba255a service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:49.210081 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-c7d49562-98f4-4462-af35-41d9214137ab req-e185ca4a-c555-4cb3-857d-e47787ba255a service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:49.222300 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-c7d49562-98f4-4462-af35-41d9214137ab req-e185ca4a-c555-4cb3-857d-e47787ba255a service nova] Creating event network-vif-deleted:27712d05-cbfb-45c1-a1bc-a52d3f0584e7 for instance 37885d5b-9597-417c-9d29-bd637383943d on hv-cinder-82786 Feb 08 16:53:49.228283 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-c7d49562-98f4-4462-af35-41d9214137ab req-e185ca4a-c555-4cb3-857d-e47787ba255a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031723 Feb 08 16:53:49.228886 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 607/1220] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:53:50.130817 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-3f276219-09f1-423e-90e4-ee0026c34333 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:50.132089 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-3f276219-09f1-423e-90e4-ee0026c34333 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:53:50.138716 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3f276219-09f1-423e-90e4-ee0026c34333 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:50.139018 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3f276219-09f1-423e-90e4-ee0026c34333 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:50.139841 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3f276219-09f1-423e-90e4-ee0026c34333 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:50.140292 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-3f276219-09f1-423e-90e4-ee0026c34333 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:50.154939 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-3f276219-09f1-423e-90e4-ee0026c34333 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] HTTP exception thrown: Instance 37885d5b-9597-417c-9d29-bd637383943d could not be found. Feb 08 16:53:50.155540 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-3f276219-09f1-423e-90e4-ee0026c34333 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Returning 404 to user: Instance 37885d5b-9597-417c-9d29-bd637383943d could not be found. {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:53:50.156431 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-3f276219-09f1-423e-90e4-ee0026c34333 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 404 len: 111 microversion: 2.1 time: 0.029688 Feb 08 16:53:50.158269 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 614/1221] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:53:50 2022] GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:53:50.254530 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-67fdc1fb-f10f-452f-ab5b-046cd39f7cfe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-513213640", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1759950308", "security_groups": [{"name": "tempest-secgroup-smoke-1984801726"}], "block_device_mapping_v2": [{"uuid": "0d787bc8-5474-4a1d-9ccf-9c93837bb892", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d9762a02-45ed-4a30-9de3-b53831035fee"}]}} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:53:50.371062 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.network.neutron [None req-67fdc1fb-f10f-452f-ab5b-046cd39f7cfe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] validate_networks() for [('d9762a02-45ed-4a30-9de3-b53831035fee', None, None, None, None, None)] {{(pid=122901) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 16:53:50.821221 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-67fdc1fb-f10f-452f-ab5b-046cd39f7cfe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Flavor limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 16:53:50.821650 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-67fdc1fb-f10f-452f-ab5b-046cd39f7cfe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Image limits 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 16:53:50.822129 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-67fdc1fb-f10f-452f-ab5b-046cd39f7cfe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Flavor pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 16:53:50.822539 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-67fdc1fb-f10f-452f-ab5b-046cd39f7cfe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Image pref 0:0:0 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 16:53:50.822954 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.virt.hardware [None req-67fdc1fb-f10f-452f-ab5b-046cd39f7cfe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 16:53:50.831504 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-67fdc1fb-f10f-452f-ab5b-046cd39f7cfe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:50.831994 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-67fdc1fb-f10f-452f-ab5b-046cd39f7cfe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:50.833331 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-67fdc1fb-f10f-452f-ab5b-046cd39f7cfe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:50.833770 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-67fdc1fb-f10f-452f-ab5b-046cd39f7cfe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:50.850297 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-67fdc1fb-f10f-452f-ab5b-046cd39f7cfe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Getting quotas for project 9a449e431c5240b897d5cab55009fdbf. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:53:50.854228 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.quota [None req-67fdc1fb-f10f-452f-ab5b-046cd39f7cfe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Getting quotas for user cd913a6397564f859fa9f1dd1edd4596 and project 9a449e431c5240b897d5cab55009fdbf. Resources: {'cores', 'ram', 'instances'} {{(pid=122901) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:53:50.909007 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-67fdc1fb-f10f-452f-ab5b-046cd39f7cfe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Going to run 1 instances... {{(pid=122901) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 16:53:50.911873 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-67fdc1fb-f10f-452f-ab5b-046cd39f7cfe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 79af884c-4bb0-4d52-8b3a-7defe3227c9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0d787bc8-5474-4a1d-9ccf-9c93837bb892',volume_size=None,volume_type=None)] {{(pid=122901) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 16:53:51.033509 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-67fdc1fb-f10f-452f-ab5b-046cd39f7cfe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.783687 Feb 08 16:53:51.034150 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 608/1222] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Feb 8 16:53:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 16:53:51.043944 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-66abaf45-24c7-469f-b861-321dfa8b35d0 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:51.044559 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-66abaf45-24c7-469f-b861-321dfa8b35d0 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 79af884c-4bb0-4d52-8b3a-7defe3227c9b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:53:51.096971 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-66abaf45-24c7-469f-b861-321dfa8b35d0 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:53:51.103953 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-66abaf45-24c7-469f-b861-321dfa8b35d0 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b" status: 200 len: 1094 microversion: 2.1 time: 0.063641 Feb 08 16:53:51.104614 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 615/1223] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:53:51 2022] GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:53:52.121171 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-673fe768-3bfa-4367-8828-f685a49bc6a1 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:52.122366 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-673fe768-3bfa-4367-8828-f685a49bc6a1 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 79af884c-4bb0-4d52-8b3a-7defe3227c9b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:53:52.131929 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-673fe768-3bfa-4367-8828-f685a49bc6a1 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:52.132411 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-673fe768-3bfa-4367-8828-f685a49bc6a1 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:52.133209 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-673fe768-3bfa-4367-8828-f685a49bc6a1 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:52.133649 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-673fe768-3bfa-4367-8828-f685a49bc6a1 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:52.220145 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-673fe768-3bfa-4367-8828-f685a49bc6a1 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:53:52.227550 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-673fe768-3bfa-4367-8828-f685a49bc6a1 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b" status: 200 len: 1210 microversion: 2.1 time: 0.110754 Feb 08 16:53:52.228148 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 609/1224] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:53:52 2022] GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b => generated 1210 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:53:53.245477 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-24f21443-ad1c-4c62-9f36-375e5289853a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:53.246212 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-24f21443-ad1c-4c62-9f36-375e5289853a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 79af884c-4bb0-4d52-8b3a-7defe3227c9b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:53:53.253927 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-24f21443-ad1c-4c62-9f36-375e5289853a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:53.254554 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-24f21443-ad1c-4c62-9f36-375e5289853a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:53.256059 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-24f21443-ad1c-4c62-9f36-375e5289853a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:53.256642 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-24f21443-ad1c-4c62-9f36-375e5289853a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:53.308508 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-f2dc5df0-32d6-4e54-95b7-491d0b747677 req-dcb661ad-34c7-472c-8f7b-8581b08e8010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79af884c-4bb0-4d52-8b3a-7defe3227c9b", "tag": "b53a3dcc-0b53-4ab1-9b7a-8662ca29e08a"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:53:53.312102 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:53:53.312102 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:53:53.326386 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-f2dc5df0-32d6-4e54-95b7-491d0b747677 req-dcb661ad-34c7-472c-8f7b-8581b08e8010 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:53.335799 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-f2dc5df0-32d6-4e54-95b7-491d0b747677 req-dcb661ad-34c7-472c-8f7b-8581b08e8010 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:53.349302 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-f2dc5df0-32d6-4e54-95b7-491d0b747677 req-dcb661ad-34c7-472c-8f7b-8581b08e8010 service nova] Creating event network-changed:b53a3dcc-0b53-4ab1-9b7a-8662ca29e08a for instance 79af884c-4bb0-4d52-8b3a-7defe3227c9b on hv-cinder-82786 Feb 08 16:53:53.354551 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-f2dc5df0-32d6-4e54-95b7-491d0b747677 req-dcb661ad-34c7-472c-8f7b-8581b08e8010 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050127 Feb 08 16:53:53.355662 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 610/1225] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:53:53.425350 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-24f21443-ad1c-4c62-9f36-375e5289853a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:53:53.433793 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-24f21443-ad1c-4c62-9f36-375e5289853a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b" status: 200 len: 1266 microversion: 2.1 time: 0.192201 Feb 08 16:53:53.434369 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 616/1226] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:53:53 2022] GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:53:54.451389 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-a8b0d945-f2da-44a6-b8c4-2fccdd435b4a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:54.452045 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-a8b0d945-f2da-44a6-b8c4-2fccdd435b4a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 79af884c-4bb0-4d52-8b3a-7defe3227c9b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:53:54.458760 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a8b0d945-f2da-44a6-b8c4-2fccdd435b4a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:54.459212 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a8b0d945-f2da-44a6-b8c4-2fccdd435b4a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:54.460035 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a8b0d945-f2da-44a6-b8c4-2fccdd435b4a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:54.460500 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a8b0d945-f2da-44a6-b8c4-2fccdd435b4a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:54.592468 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-a8b0d945-f2da-44a6-b8c4-2fccdd435b4a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:53:54.599657 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-a8b0d945-f2da-44a6-b8c4-2fccdd435b4a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b" status: 200 len: 1266 microversion: 2.1 time: 0.152748 Feb 08 16:53:54.600248 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 611/1227] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:53:54 2022] GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:53:55.615595 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-0ccc8df8-fa36-40e8-9614-a19d48b790b2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:55.616171 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-0ccc8df8-fa36-40e8-9614-a19d48b790b2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 79af884c-4bb0-4d52-8b3a-7defe3227c9b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:53:55.622127 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0ccc8df8-fa36-40e8-9614-a19d48b790b2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:55.622573 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0ccc8df8-fa36-40e8-9614-a19d48b790b2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:55.623344 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0ccc8df8-fa36-40e8-9614-a19d48b790b2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:55.623803 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-0ccc8df8-fa36-40e8-9614-a19d48b790b2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:55.760739 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-0ccc8df8-fa36-40e8-9614-a19d48b790b2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:53:55.768036 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-0ccc8df8-fa36-40e8-9614-a19d48b790b2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b" status: 200 len: 1266 microversion: 2.1 time: 0.156240 Feb 08 16:53:55.768596 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 617/1228] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:53:55 2022] GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:53:56.785094 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-639db2c3-fc06-44ea-b80e-258ce7320d3c tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:56.785695 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-639db2c3-fc06-44ea-b80e-258ce7320d3c tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 79af884c-4bb0-4d52-8b3a-7defe3227c9b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:53:56.793109 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-639db2c3-fc06-44ea-b80e-258ce7320d3c tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:56.793579 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-639db2c3-fc06-44ea-b80e-258ce7320d3c tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:56.794376 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-639db2c3-fc06-44ea-b80e-258ce7320d3c tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:56.794819 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-639db2c3-fc06-44ea-b80e-258ce7320d3c tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:56.930781 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-639db2c3-fc06-44ea-b80e-258ce7320d3c tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:53:56.938032 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-639db2c3-fc06-44ea-b80e-258ce7320d3c tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b" status: 200 len: 1266 microversion: 2.1 time: 0.156613 Feb 08 16:53:56.938591 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 612/1229] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:53:56 2022] GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:53:57.954035 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-fb10e22a-99c9-4e4d-a87e-37712f0d2495 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:57.954652 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-fb10e22a-99c9-4e4d-a87e-37712f0d2495 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 79af884c-4bb0-4d52-8b3a-7defe3227c9b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:53:57.961119 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb10e22a-99c9-4e4d-a87e-37712f0d2495 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:57.961576 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb10e22a-99c9-4e4d-a87e-37712f0d2495 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:57.962365 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb10e22a-99c9-4e4d-a87e-37712f0d2495 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:57.962816 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb10e22a-99c9-4e4d-a87e-37712f0d2495 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:58.108261 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-fb10e22a-99c9-4e4d-a87e-37712f0d2495 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:53:58.116305 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-fb10e22a-99c9-4e4d-a87e-37712f0d2495 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b" status: 200 len: 1266 microversion: 2.1 time: 0.165972 Feb 08 16:53:58.116865 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 618/1230] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:53:57 2022] GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:53:59.132061 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ff10e918-af13-4485-a67d-8df9b324c6fe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:53:59.132686 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-ff10e918-af13-4485-a67d-8df9b324c6fe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 79af884c-4bb0-4d52-8b3a-7defe3227c9b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:53:59.139197 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ff10e918-af13-4485-a67d-8df9b324c6fe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:59.139654 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ff10e918-af13-4485-a67d-8df9b324c6fe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:59.140481 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ff10e918-af13-4485-a67d-8df9b324c6fe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:53:59.140924 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ff10e918-af13-4485-a67d-8df9b324c6fe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:53:59.275804 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ff10e918-af13-4485-a67d-8df9b324c6fe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:53:59.283034 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-ff10e918-af13-4485-a67d-8df9b324c6fe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b" status: 200 len: 1266 microversion: 2.1 time: 0.154862 Feb 08 16:53:59.283585 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 613/1231] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:53:59 2022] GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:54:00.300125 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-eb35dce8-2419-46c5-8beb-b8f3d64c5a77 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:54:00.300742 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-eb35dce8-2419-46c5-8beb-b8f3d64c5a77 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 79af884c-4bb0-4d52-8b3a-7defe3227c9b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:54:00.307180 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eb35dce8-2419-46c5-8beb-b8f3d64c5a77 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:54:00.307641 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eb35dce8-2419-46c5-8beb-b8f3d64c5a77 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:54:00.308459 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eb35dce8-2419-46c5-8beb-b8f3d64c5a77 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:54:00.308902 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-eb35dce8-2419-46c5-8beb-b8f3d64c5a77 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:54:00.440175 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-eb35dce8-2419-46c5-8beb-b8f3d64c5a77 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:54:00.448522 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-eb35dce8-2419-46c5-8beb-b8f3d64c5a77 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b" status: 200 len: 1266 microversion: 2.1 time: 0.151996 Feb 08 16:54:00.449072 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 619/1232] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:54:00 2022] GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:54:01.465634 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-1a3dbe51-692e-41a3-975f-d0ef82ca45e2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:54:01.466248 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-1a3dbe51-692e-41a3-975f-d0ef82ca45e2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 79af884c-4bb0-4d52-8b3a-7defe3227c9b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:54:01.473298 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1a3dbe51-692e-41a3-975f-d0ef82ca45e2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:54:01.473754 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1a3dbe51-692e-41a3-975f-d0ef82ca45e2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:54:01.474614 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1a3dbe51-692e-41a3-975f-d0ef82ca45e2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:54:01.475704 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1a3dbe51-692e-41a3-975f-d0ef82ca45e2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:54:01.621836 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-1a3dbe51-692e-41a3-975f-d0ef82ca45e2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:54:01.631114 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-1a3dbe51-692e-41a3-975f-d0ef82ca45e2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b" status: 200 len: 1266 microversion: 2.1 time: 0.169637 Feb 08 16:54:01.631854 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 614/1233] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:54:01 2022] GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:54:02.649589 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-c8617b94-4a6b-4f9e-b639-05bf7eed7f46 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:54:02.650210 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-c8617b94-4a6b-4f9e-b639-05bf7eed7f46 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 79af884c-4bb0-4d52-8b3a-7defe3227c9b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:54:02.656767 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c8617b94-4a6b-4f9e-b639-05bf7eed7f46 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:54:02.657222 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c8617b94-4a6b-4f9e-b639-05bf7eed7f46 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:54:02.658039 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c8617b94-4a6b-4f9e-b639-05bf7eed7f46 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:54:02.658484 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-c8617b94-4a6b-4f9e-b639-05bf7eed7f46 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:54:02.797945 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-c8617b94-4a6b-4f9e-b639-05bf7eed7f46 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:54:02.805346 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-c8617b94-4a6b-4f9e-b639-05bf7eed7f46 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b" status: 200 len: 1266 microversion: 2.1 time: 0.159469 Feb 08 16:54:02.805913 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 620/1234] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:54:02 2022] GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:54:03.822057 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-bf1d0d7e-9a14-41f6-b71d-c9085038ce73 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:54:03.822718 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-bf1d0d7e-9a14-41f6-b71d-c9085038ce73 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 79af884c-4bb0-4d52-8b3a-7defe3227c9b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:54:03.829408 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bf1d0d7e-9a14-41f6-b71d-c9085038ce73 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:54:03.830047 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bf1d0d7e-9a14-41f6-b71d-c9085038ce73 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:54:03.830864 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bf1d0d7e-9a14-41f6-b71d-c9085038ce73 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:54:03.831370 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-bf1d0d7e-9a14-41f6-b71d-c9085038ce73 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:54:03.965503 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-bf1d0d7e-9a14-41f6-b71d-c9085038ce73 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:54:03.972834 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-bf1d0d7e-9a14-41f6-b71d-c9085038ce73 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b" status: 200 len: 1266 microversion: 2.1 time: 0.154473 Feb 08 16:54:03.973559 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 615/1235] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:54:03 2022] GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:54:04.742669 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-d9f30fc4-fa57-43f9-b402-b6292aea1920 req-8b660538-1b0e-42db-a07f-658b423429ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79af884c-4bb0-4d52-8b3a-7defe3227c9b", "name": "network-vif-plugged", "status": "completed", "tag": "b53a3dcc-0b53-4ab1-9b7a-8662ca29e08a"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:54:04.744286 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:54:04.744286 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:54:04.751329 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-d9f30fc4-fa57-43f9-b402-b6292aea1920 req-8b660538-1b0e-42db-a07f-658b423429ac service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:54:04.751790 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-d9f30fc4-fa57-43f9-b402-b6292aea1920 req-8b660538-1b0e-42db-a07f-658b423429ac service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:54:04.762503 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-d9f30fc4-fa57-43f9-b402-b6292aea1920 req-8b660538-1b0e-42db-a07f-658b423429ac service nova] Creating event network-vif-plugged:b53a3dcc-0b53-4ab1-9b7a-8662ca29e08a for instance 79af884c-4bb0-4d52-8b3a-7defe3227c9b on hv-cinder-82786 Feb 08 16:54:04.767557 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-d9f30fc4-fa57-43f9-b402-b6292aea1920 req-8b660538-1b0e-42db-a07f-658b423429ac service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177540 Feb 08 16:54:04.768149 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 621/1236] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:54:04.989083 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-cd164ee0-1f6a-4dcb-9488-1029a4e22ac2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:54:04.989702 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-cd164ee0-1f6a-4dcb-9488-1029a4e22ac2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 79af884c-4bb0-4d52-8b3a-7defe3227c9b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:54:04.996170 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cd164ee0-1f6a-4dcb-9488-1029a4e22ac2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:54:04.996634 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cd164ee0-1f6a-4dcb-9488-1029a4e22ac2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:54:04.997427 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cd164ee0-1f6a-4dcb-9488-1029a4e22ac2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:54:04.997870 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-cd164ee0-1f6a-4dcb-9488-1029a4e22ac2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:54:05.132515 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-cd164ee0-1f6a-4dcb-9488-1029a4e22ac2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:54:05.139821 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-cd164ee0-1f6a-4dcb-9488-1029a4e22ac2 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b" status: 200 len: 1266 microversion: 2.1 time: 0.154427 Feb 08 16:54:05.140397 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 616/1237] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:54:04 2022] GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:54:06.157930 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-63d553d8-0a4f-451c-83f4-e661936ab9aa tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:54:06.158663 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-63d553d8-0a4f-451c-83f4-e661936ab9aa tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 79af884c-4bb0-4d52-8b3a-7defe3227c9b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:54:06.165472 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-63d553d8-0a4f-451c-83f4-e661936ab9aa tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:54:06.165925 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-63d553d8-0a4f-451c-83f4-e661936ab9aa tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:54:06.166711 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-63d553d8-0a4f-451c-83f4-e661936ab9aa tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:54:06.167151 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-63d553d8-0a4f-451c-83f4-e661936ab9aa tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:54:06.305914 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-63d553d8-0a4f-451c-83f4-e661936ab9aa tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:54:06.314410 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-63d553d8-0a4f-451c-83f4-e661936ab9aa tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b" status: 200 len: 1266 microversion: 2.1 time: 0.160895 Feb 08 16:54:06.314983 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 622/1238] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:54:06 2022] GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:54:07.332041 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-7694adfa-7cb8-43ce-bc24-e5c65f5a5991 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:54:07.332647 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-7694adfa-7cb8-43ce-bc24-e5c65f5a5991 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 79af884c-4bb0-4d52-8b3a-7defe3227c9b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:54:07.339042 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7694adfa-7cb8-43ce-bc24-e5c65f5a5991 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:54:07.339492 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7694adfa-7cb8-43ce-bc24-e5c65f5a5991 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:54:07.340294 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7694adfa-7cb8-43ce-bc24-e5c65f5a5991 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:54:07.340734 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-7694adfa-7cb8-43ce-bc24-e5c65f5a5991 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:54:07.472111 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-7694adfa-7cb8-43ce-bc24-e5c65f5a5991 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:54:07.479466 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-7694adfa-7cb8-43ce-bc24-e5c65f5a5991 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b" status: 200 len: 1453 microversion: 2.1 time: 0.151109 Feb 08 16:54:07.480089 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 617/1239] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:54:07 2022] GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:54:07.495358 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-fb45d32f-3b58-4091-9d90-2cc3e9c32c9f tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:54:07.496046 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-fb45d32f-3b58-4091-9d90-2cc3e9c32c9f tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 79af884c-4bb0-4d52-8b3a-7defe3227c9b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:54:07.502444 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb45d32f-3b58-4091-9d90-2cc3e9c32c9f tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:54:07.502890 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb45d32f-3b58-4091-9d90-2cc3e9c32c9f tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:54:07.503661 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb45d32f-3b58-4091-9d90-2cc3e9c32c9f tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:54:07.504124 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fb45d32f-3b58-4091-9d90-2cc3e9c32c9f tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:54:07.641822 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-fb45d32f-3b58-4091-9d90-2cc3e9c32c9f tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:54:07.649192 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-fb45d32f-3b58-4091-9d90-2cc3e9c32c9f tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b" status: 200 len: 1453 microversion: 2.1 time: 0.157485 Feb 08 16:54:07.649758 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 623/1240] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:54:07 2022] GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:54:09.391763 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 16:54:09.392556 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: Tue Feb 8 16:54:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 16:54:09.617463 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-f4a83d0c-abb2-4697-9047-8f2e1c1532a5 req-09152540-e39b-49f7-89c5-6ef442654e59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79af884c-4bb0-4d52-8b3a-7defe3227c9b", "tag": "b53a3dcc-0b53-4ab1-9b7a-8662ca29e08a"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:54:09.619002 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:54:09.619002 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:54:09.626210 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-f4a83d0c-abb2-4697-9047-8f2e1c1532a5 req-09152540-e39b-49f7-89c5-6ef442654e59 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:54:09.626659 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-f4a83d0c-abb2-4697-9047-8f2e1c1532a5 req-09152540-e39b-49f7-89c5-6ef442654e59 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:54:09.638060 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-f4a83d0c-abb2-4697-9047-8f2e1c1532a5 req-09152540-e39b-49f7-89c5-6ef442654e59 service nova] Creating event network-changed:b53a3dcc-0b53-4ab1-9b7a-8662ca29e08a for instance 79af884c-4bb0-4d52-8b3a-7defe3227c9b on hv-cinder-82786 Feb 08 16:54:09.643138 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-f4a83d0c-abb2-4697-9047-8f2e1c1532a5 req-09152540-e39b-49f7-89c5-6ef442654e59 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139644 Feb 08 16:54:09.643944 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 618/1241] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:55:02.347169 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 16:55:02.347922 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: Tue Feb 8 16:55:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 16:56:09.418380 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-174b80ba-a2cb-43ad-b056-d081986268b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1224193576", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1759950308", "security_groups": [{"name": "tempest-secgroup-smoke-1984801726"}], "block_device_mapping_v2": [{"uuid": "1842e7bb-c424-4043-8abf-52b9a9f94fe7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d9762a02-45ed-4a30-9de3-b53831035fee"}]}} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:56:09.539711 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.network.neutron [None req-174b80ba-a2cb-43ad-b056-d081986268b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] validate_networks() for [('d9762a02-45ed-4a30-9de3-b53831035fee', None, None, None, None, None)] {{(pid=122902) validate_networks /opt/stack/nova/nova/network/neutron.py:2494}} Feb 08 16:56:10.019560 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-174b80ba-a2cb-43ad-b056-d081986268b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Flavor limits 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 08 16:56:10.020029 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-174b80ba-a2cb-43ad-b056-d081986268b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Image limits 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 08 16:56:10.020535 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-174b80ba-a2cb-43ad-b056-d081986268b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Flavor pref 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 08 16:56:10.020966 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-174b80ba-a2cb-43ad-b056-d081986268b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Image pref 0:0:0 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 08 16:56:10.021381 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.virt.hardware [None req-174b80ba-a2cb-43ad-b056-d081986268b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 08 16:56:10.031621 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-174b80ba-a2cb-43ad-b056-d081986268b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:10.032110 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-174b80ba-a2cb-43ad-b056-d081986268b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:10.032926 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-174b80ba-a2cb-43ad-b056-d081986268b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:10.033358 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-174b80ba-a2cb-43ad-b056-d081986268b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:10.052137 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-174b80ba-a2cb-43ad-b056-d081986268b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Getting quotas for project 9a449e431c5240b897d5cab55009fdbf. Resources: {'cores', 'ram', 'instances'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 08 16:56:10.056282 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.quota [None req-174b80ba-a2cb-43ad-b056-d081986268b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Getting quotas for user cd913a6397564f859fa9f1dd1edd4596 and project 9a449e431c5240b897d5cab55009fdbf. Resources: {'cores', 'ram', 'instances'} {{(pid=122902) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 08 16:56:10.114063 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-174b80ba-a2cb-43ad-b056-d081986268b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Going to run 1 instances... {{(pid=122902) _provision_instances /opt/stack/nova/nova/compute/api.py:1351}} Feb 08 16:56:10.116542 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-174b80ba-a2cb-43ad-b056-d081986268b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1842e7bb-c424-4043-8abf-52b9a9f94fe7',volume_size=None,volume_type=None)] {{(pid=122902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1758}} Feb 08 16:56:10.247498 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: ERROR oslo.messaging._drivers.impl_rabbit [None req-174b80ba-a2cb-43ad-b056-d081986268b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [f2c2ee4f-df2e-4c54-8828-a50b32ea41bc] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 08 16:56:11.255318 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO oslo.messaging._drivers.impl_rabbit [None req-174b80ba-a2cb-43ad-b056-d081986268b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [f2c2ee4f-df2e-4c54-8828-a50b32ea41bc] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 52338. Feb 08 16:56:11.259365 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-174b80ba-a2cb-43ad-b056-d081986268b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.845806 Feb 08 16:56:11.260055 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 624/1242] 10.222.0.35 () {60 vars in 1146 bytes} [Tue Feb 8 16:56:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 08 16:56:11.273469 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-635026d7-af44-4aee-a6eb-7678d8ccc7a4 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:56:11.274175 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-635026d7-af44-4aee-a6eb-7678d8ccc7a4 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:56:11.333818 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-635026d7-af44-4aee-a6eb-7678d8ccc7a4 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:56:11.344479 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-635026d7-af44-4aee-a6eb-7678d8ccc7a4 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 200 len: 1095 microversion: 2.1 time: 0.076093 Feb 08 16:56:11.345239 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 619/1243] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:56:11 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:56:12.367520 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-e475d5d7-52d6-4cf8-bbfe-da6cede0409c tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:56:12.368179 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-e475d5d7-52d6-4cf8-bbfe-da6cede0409c tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:56:12.428417 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-e475d5d7-52d6-4cf8-bbfe-da6cede0409c tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:56:12.436270 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-e475d5d7-52d6-4cf8-bbfe-da6cede0409c tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 200 len: 1095 microversion: 2.1 time: 0.072776 Feb 08 16:56:12.436856 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 625/1244] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:56:12 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:56:13.455375 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-5c0991cc-fa86-4e39-a041-3ac404b13bb9 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:56:13.456449 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-5c0991cc-fa86-4e39-a041-3ac404b13bb9 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:56:13.529318 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-5c0991cc-fa86-4e39-a041-3ac404b13bb9 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:56:13.537444 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-5c0991cc-fa86-4e39-a041-3ac404b13bb9 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 200 len: 1095 microversion: 2.1 time: 0.088805 Feb 08 16:56:13.538262 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 620/1245] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:56:13 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 1095 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:56:14.558134 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-4ea50321-bfcc-4346-ad1e-f03f8051cd97 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:56:14.558837 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-4ea50321-bfcc-4346-ad1e-f03f8051cd97 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:56:14.617197 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-4ea50321-bfcc-4346-ad1e-f03f8051cd97 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:56:14.625936 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-4ea50321-bfcc-4346-ad1e-f03f8051cd97 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 200 len: 1095 microversion: 2.1 time: 0.071220 Feb 08 16:56:14.626742 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 626/1246] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:56:14 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:56:15.648756 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-4a954f3a-ead5-4fea-9a8d-f20218920852 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:56:15.649367 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-4a954f3a-ead5-4fea-9a8d-f20218920852 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:56:15.656313 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4a954f3a-ead5-4fea-9a8d-f20218920852 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:15.656774 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4a954f3a-ead5-4fea-9a8d-f20218920852 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:15.657568 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4a954f3a-ead5-4fea-9a8d-f20218920852 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:15.658009 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-4a954f3a-ead5-4fea-9a8d-f20218920852 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:15.724545 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-4a954f3a-ead5-4fea-9a8d-f20218920852 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:56:15.732147 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-4a954f3a-ead5-4fea-9a8d-f20218920852 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 200 len: 1145 microversion: 2.1 time: 0.087032 Feb 08 16:56:15.732728 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 621/1247] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:56:15 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:56:16.750451 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-a02034e3-e66b-4004-a924-78c0184b9664 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:56:16.751825 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-a02034e3-e66b-4004-a924-78c0184b9664 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:56:16.760070 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a02034e3-e66b-4004-a924-78c0184b9664 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:16.760516 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a02034e3-e66b-4004-a924-78c0184b9664 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:16.761578 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a02034e3-e66b-4004-a924-78c0184b9664 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:16.762340 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-a02034e3-e66b-4004-a924-78c0184b9664 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:16.826644 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-a02034e3-e66b-4004-a924-78c0184b9664 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:56:16.835921 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-a02034e3-e66b-4004-a924-78c0184b9664 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 200 len: 1211 microversion: 2.1 time: 0.089623 Feb 08 16:56:16.845664 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 627/1248] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:56:16 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:56:17.710697 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-dff8e47d-a77f-42f7-a566-38e3274531a8 req-a5e897bb-3e95-406c-8947-fab83c4c3f50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3d8299-e098-4a1e-8875-9f5edf8281ba", "tag": "1188ffc3-d898-4abd-af14-4e2430064c04"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:56:17.716235 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:56:17.716235 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:56:17.735848 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-dff8e47d-a77f-42f7-a566-38e3274531a8 req-a5e897bb-3e95-406c-8947-fab83c4c3f50 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:17.737437 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-dff8e47d-a77f-42f7-a566-38e3274531a8 req-a5e897bb-3e95-406c-8947-fab83c4c3f50 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:17.749506 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-dff8e47d-a77f-42f7-a566-38e3274531a8 req-a5e897bb-3e95-406c-8947-fab83c4c3f50 service nova] Creating event network-changed:1188ffc3-d898-4abd-af14-4e2430064c04 for instance 5f3d8299-e098-4a1e-8875-9f5edf8281ba on hv-cinder-82786 Feb 08 16:56:17.754967 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-dff8e47d-a77f-42f7-a566-38e3274531a8 req-a5e897bb-3e95-406c-8947-fab83c4c3f50 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054978 Feb 08 16:56:17.755584 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 622/1249] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:56:17.857354 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-063d8c14-13ef-4f54-9db2-c05d195a003e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:56:17.857975 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-063d8c14-13ef-4f54-9db2-c05d195a003e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:56:17.866266 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-063d8c14-13ef-4f54-9db2-c05d195a003e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:17.866874 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-063d8c14-13ef-4f54-9db2-c05d195a003e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:17.867884 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-063d8c14-13ef-4f54-9db2-c05d195a003e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:17.868638 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-063d8c14-13ef-4f54-9db2-c05d195a003e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:18.017371 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-063d8c14-13ef-4f54-9db2-c05d195a003e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:56:18.024773 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-063d8c14-13ef-4f54-9db2-c05d195a003e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 200 len: 1267 microversion: 2.1 time: 0.171216 Feb 08 16:56:18.025459 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 628/1250] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:56:17 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:56:19.042770 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-a05e0e8e-357b-4c0b-8ef7-ccc943e8b567 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:56:19.043473 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-a05e0e8e-357b-4c0b-8ef7-ccc943e8b567 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:56:19.050184 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a05e0e8e-357b-4c0b-8ef7-ccc943e8b567 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:19.050630 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a05e0e8e-357b-4c0b-8ef7-ccc943e8b567 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:19.051415 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a05e0e8e-357b-4c0b-8ef7-ccc943e8b567 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:19.051887 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-a05e0e8e-357b-4c0b-8ef7-ccc943e8b567 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:19.195704 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-a05e0e8e-357b-4c0b-8ef7-ccc943e8b567 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:56:19.204020 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-a05e0e8e-357b-4c0b-8ef7-ccc943e8b567 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 200 len: 1267 microversion: 2.1 time: 0.165199 Feb 08 16:56:19.204626 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 623/1251] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:56:19 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:56:20.221376 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-43656b12-2af1-4dc9-a117-e7623821357a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:56:20.221992 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-43656b12-2af1-4dc9-a117-e7623821357a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:56:20.229715 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-43656b12-2af1-4dc9-a117-e7623821357a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:20.230178 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-43656b12-2af1-4dc9-a117-e7623821357a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:20.230979 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-43656b12-2af1-4dc9-a117-e7623821357a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:20.231420 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-43656b12-2af1-4dc9-a117-e7623821357a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:20.379531 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-43656b12-2af1-4dc9-a117-e7623821357a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:56:20.387168 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-43656b12-2af1-4dc9-a117-e7623821357a tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 200 len: 1267 microversion: 2.1 time: 0.170229 Feb 08 16:56:20.387786 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 629/1252] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:56:20 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:56:21.404856 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-440ef60a-0227-44ee-973d-b5f9ce2a8346 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:56:21.406020 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-440ef60a-0227-44ee-973d-b5f9ce2a8346 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:56:21.412512 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-440ef60a-0227-44ee-973d-b5f9ce2a8346 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:21.413078 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-440ef60a-0227-44ee-973d-b5f9ce2a8346 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:21.413765 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-440ef60a-0227-44ee-973d-b5f9ce2a8346 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:21.414207 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-440ef60a-0227-44ee-973d-b5f9ce2a8346 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:21.554384 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-440ef60a-0227-44ee-973d-b5f9ce2a8346 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:56:21.562180 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-440ef60a-0227-44ee-973d-b5f9ce2a8346 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 200 len: 1267 microversion: 2.1 time: 0.160726 Feb 08 16:56:21.562769 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 624/1253] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:56:21 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:56:22.579810 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-6dd93f4a-3ce4-423b-babb-f6f5aafcfe39 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:56:22.580627 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-6dd93f4a-3ce4-423b-babb-f6f5aafcfe39 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:56:22.586609 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6dd93f4a-3ce4-423b-babb-f6f5aafcfe39 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:22.587058 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6dd93f4a-3ce4-423b-babb-f6f5aafcfe39 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:22.587883 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6dd93f4a-3ce4-423b-babb-f6f5aafcfe39 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:22.588325 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6dd93f4a-3ce4-423b-babb-f6f5aafcfe39 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:22.726282 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-6dd93f4a-3ce4-423b-babb-f6f5aafcfe39 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:56:22.733861 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-6dd93f4a-3ce4-423b-babb-f6f5aafcfe39 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 200 len: 1267 microversion: 2.1 time: 0.158803 Feb 08 16:56:22.734430 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 630/1254] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:56:22 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:56:23.752908 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-466579e3-86b5-4933-a178-ee370469bbe0 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:56:23.753516 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-466579e3-86b5-4933-a178-ee370469bbe0 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:56:23.761344 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-466579e3-86b5-4933-a178-ee370469bbe0 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:23.761997 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-466579e3-86b5-4933-a178-ee370469bbe0 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:23.762900 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-466579e3-86b5-4933-a178-ee370469bbe0 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:23.763526 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-466579e3-86b5-4933-a178-ee370469bbe0 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:23.915020 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-466579e3-86b5-4933-a178-ee370469bbe0 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:56:23.923492 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-466579e3-86b5-4933-a178-ee370469bbe0 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 200 len: 1267 microversion: 2.1 time: 0.175900 Feb 08 16:56:23.924120 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 625/1255] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:56:23 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:56:24.940175 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-89401576-c03d-4f2b-ac68-f0c91634c235 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:56:24.940776 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-89401576-c03d-4f2b-ac68-f0c91634c235 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:56:24.947713 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-89401576-c03d-4f2b-ac68-f0c91634c235 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:24.948194 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-89401576-c03d-4f2b-ac68-f0c91634c235 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:24.949003 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-89401576-c03d-4f2b-ac68-f0c91634c235 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:24.949447 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-89401576-c03d-4f2b-ac68-f0c91634c235 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:25.105369 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-89401576-c03d-4f2b-ac68-f0c91634c235 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:56:25.112928 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-89401576-c03d-4f2b-ac68-f0c91634c235 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 200 len: 1267 microversion: 2.1 time: 0.176729 Feb 08 16:56:25.113494 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 631/1256] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:56:24 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:56:26.130442 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-f57a7e7c-460f-4794-8f7e-1673b6d9b3fe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:56:26.131055 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-f57a7e7c-460f-4794-8f7e-1673b6d9b3fe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:56:26.137730 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f57a7e7c-460f-4794-8f7e-1673b6d9b3fe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:26.138178 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f57a7e7c-460f-4794-8f7e-1673b6d9b3fe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:26.138974 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f57a7e7c-460f-4794-8f7e-1673b6d9b3fe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:26.140143 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-f57a7e7c-460f-4794-8f7e-1673b6d9b3fe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:26.283210 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-f57a7e7c-460f-4794-8f7e-1673b6d9b3fe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:56:26.290553 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-f57a7e7c-460f-4794-8f7e-1673b6d9b3fe tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 200 len: 1267 microversion: 2.1 time: 0.164088 Feb 08 16:56:26.291126 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 626/1257] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:56:26 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:56:27.307903 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-cf1df2e4-3386-4fdf-bfdf-9012a913d3ee tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:56:27.308891 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-cf1df2e4-3386-4fdf-bfdf-9012a913d3ee tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:56:27.316248 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cf1df2e4-3386-4fdf-bfdf-9012a913d3ee tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:27.316698 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cf1df2e4-3386-4fdf-bfdf-9012a913d3ee tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:27.317502 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cf1df2e4-3386-4fdf-bfdf-9012a913d3ee tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:27.317934 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-cf1df2e4-3386-4fdf-bfdf-9012a913d3ee tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:27.467994 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-cf1df2e4-3386-4fdf-bfdf-9012a913d3ee tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:56:27.476194 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-cf1df2e4-3386-4fdf-bfdf-9012a913d3ee tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 200 len: 1267 microversion: 2.1 time: 0.172305 Feb 08 16:56:27.476816 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 632/1258] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:56:27 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:56:28.492837 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-ce764bf2-25dc-4f89-b677-d3956e3b32b9 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:56:28.493428 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-ce764bf2-25dc-4f89-b677-d3956e3b32b9 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:56:28.500533 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ce764bf2-25dc-4f89-b677-d3956e3b32b9 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:28.500979 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ce764bf2-25dc-4f89-b677-d3956e3b32b9 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:28.502032 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ce764bf2-25dc-4f89-b677-d3956e3b32b9 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:28.502461 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-ce764bf2-25dc-4f89-b677-d3956e3b32b9 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:28.645709 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-ce764bf2-25dc-4f89-b677-d3956e3b32b9 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:56:28.653414 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-ce764bf2-25dc-4f89-b677-d3956e3b32b9 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 200 len: 1267 microversion: 2.1 time: 0.164135 Feb 08 16:56:28.653992 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 627/1259] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:56:28 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:56:29.466106 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [req-82e9d4ef-b1b2-4feb-a9e1-8e620193cfd4 req-1a9e3fc2-6514-4687-a22a-24feecec3f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3d8299-e098-4a1e-8875-9f5edf8281ba", "name": "network-vif-plugged", "status": "completed", "tag": "1188ffc3-d898-4abd-af14-4e2430064c04"}]} {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:56:29.467704 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:56:29.467704 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: warnings.warn(msg) Feb 08 16:56:29.475450 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-82e9d4ef-b1b2-4feb-a9e1-8e620193cfd4 req-1a9e3fc2-6514-4687-a22a-24feecec3f93 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:29.475982 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [req-82e9d4ef-b1b2-4feb-a9e1-8e620193cfd4 req-1a9e3fc2-6514-4687-a22a-24feecec3f93 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:29.489018 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.compute.server_external_events [req-82e9d4ef-b1b2-4feb-a9e1-8e620193cfd4 req-1a9e3fc2-6514-4687-a22a-24feecec3f93 service nova] Creating event network-vif-plugged:1188ffc3-d898-4abd-af14-4e2430064c04 for instance 5f3d8299-e098-4a1e-8875-9f5edf8281ba on hv-cinder-82786 Feb 08 16:56:29.494735 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [req-82e9d4ef-b1b2-4feb-a9e1-8e620193cfd4 req-1a9e3fc2-6514-4687-a22a-24feecec3f93 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032156 Feb 08 16:56:29.495534 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 633/1260] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:56:29.670151 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-44053f4f-8ef1-40db-a2f8-c5e5a6225bf1 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:56:29.670771 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-44053f4f-8ef1-40db-a2f8-c5e5a6225bf1 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:56:29.677479 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-44053f4f-8ef1-40db-a2f8-c5e5a6225bf1 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:29.677984 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-44053f4f-8ef1-40db-a2f8-c5e5a6225bf1 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:29.678804 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-44053f4f-8ef1-40db-a2f8-c5e5a6225bf1 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:29.679242 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-44053f4f-8ef1-40db-a2f8-c5e5a6225bf1 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:29.874046 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-44053f4f-8ef1-40db-a2f8-c5e5a6225bf1 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:56:29.882355 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-44053f4f-8ef1-40db-a2f8-c5e5a6225bf1 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 200 len: 1267 microversion: 2.1 time: 0.215887 Feb 08 16:56:29.882922 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 628/1261] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:56:29 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:56:30.900229 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-50725a6f-108b-4176-b799-45a738d05f30 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:56:30.900937 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-50725a6f-108b-4176-b799-45a738d05f30 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:56:30.907125 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-50725a6f-108b-4176-b799-45a738d05f30 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:30.908126 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-50725a6f-108b-4176-b799-45a738d05f30 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:30.909296 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-50725a6f-108b-4176-b799-45a738d05f30 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:30.910011 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-50725a6f-108b-4176-b799-45a738d05f30 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:31.069074 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-50725a6f-108b-4176-b799-45a738d05f30 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:56:31.077066 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-50725a6f-108b-4176-b799-45a738d05f30 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 200 len: 1267 microversion: 2.1 time: 0.181280 Feb 08 16:56:31.077664 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 634/1262] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:56:30 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:56:32.094723 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-1bd61435-c901-45f0-a194-65dea61b3850 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:56:32.095891 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-1bd61435-c901-45f0-a194-65dea61b3850 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:56:32.102485 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1bd61435-c901-45f0-a194-65dea61b3850 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:32.102938 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1bd61435-c901-45f0-a194-65dea61b3850 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:32.103739 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1bd61435-c901-45f0-a194-65dea61b3850 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:32.104201 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-1bd61435-c901-45f0-a194-65dea61b3850 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:32.253822 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-1bd61435-c901-45f0-a194-65dea61b3850 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:56:32.261990 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-1bd61435-c901-45f0-a194-65dea61b3850 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 200 len: 1454 microversion: 2.1 time: 0.170979 Feb 08 16:56:32.262590 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 629/1263] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:56:32 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 1454 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:56:32.279584 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-40678175-151e-4d79-a76d-bb5941b49f17 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:56:32.280232 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-40678175-151e-4d79-a76d-bb5941b49f17 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:56:32.287036 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-40678175-151e-4d79-a76d-bb5941b49f17 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:32.287498 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-40678175-151e-4d79-a76d-bb5941b49f17 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:32.288344 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-40678175-151e-4d79-a76d-bb5941b49f17 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:32.288790 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-40678175-151e-4d79-a76d-bb5941b49f17 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:32.447920 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-40678175-151e-4d79-a76d-bb5941b49f17 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:56:32.456164 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-40678175-151e-4d79-a76d-bb5941b49f17 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 200 len: 1454 microversion: 2.1 time: 0.180377 Feb 08 16:56:32.456741 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 635/1264] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:56:32 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 1454 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:56:34.269473 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-0a454b44-e972-4e55-a03a-640754b27504 req-f07e6023-026a-45e6-956b-01bfbfc11b6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3d8299-e098-4a1e-8875-9f5edf8281ba", "tag": "1188ffc3-d898-4abd-af14-4e2430064c04"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:56:34.271911 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:56:34.271911 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:56:34.279223 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-0a454b44-e972-4e55-a03a-640754b27504 req-f07e6023-026a-45e6-956b-01bfbfc11b6a service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:56:34.279662 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-0a454b44-e972-4e55-a03a-640754b27504 req-f07e6023-026a-45e6-956b-01bfbfc11b6a service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:56:34.293510 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-0a454b44-e972-4e55-a03a-640754b27504 req-f07e6023-026a-45e6-956b-01bfbfc11b6a service nova] Creating event network-changed:1188ffc3-d898-4abd-af14-4e2430064c04 for instance 5f3d8299-e098-4a1e-8875-9f5edf8281ba on hv-cinder-82786 Feb 08 16:56:34.299323 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-0a454b44-e972-4e55-a03a-640754b27504 req-f07e6023-026a-45e6-956b-01bfbfc11b6a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032741 Feb 08 16:56:34.300105 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 630/1265] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:56:37.563355 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 16:56:37.564638 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: Tue Feb 8 16:56:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 16:57:29.401372 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 16:57:29.402027 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: Tue Feb 8 16:57:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 16:58:22.355149 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 16:58:22.355947 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: Tue Feb 8 16:58:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 16:58:24.021244 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b3e2031-2559-49c8-804b-d811ad0abe40] AMQP server on 10.222.0.35:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 08 16:58:24.024895 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: ERROR oslo.messaging._drivers.impl_rabbit [-] [20e13300-6106-4392-8fc7-3f3829534fee] AMQP server on 10.222.0.35:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Feb 08 16:58:24.025330 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-fbaa498d-3060-4dd3-9e39-c796c38c4c90 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:58:24.025968 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-fbaa498d-3060-4dd3-9e39-c796c38c4c90 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:58:24.029202 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-955eea85-ed56-42a5-bf5a-fb0bed6bc9cd req-dee5275b-ac33-41a4-8fc4-1ceb386e07f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3d8299-e098-4a1e-8875-9f5edf8281ba", "tag": "1188ffc3-d898-4abd-af14-4e2430064c04"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:58:24.030907 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:58:24.030907 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:58:24.034256 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fbaa498d-3060-4dd3-9e39-c796c38c4c90 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:24.034933 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fbaa498d-3060-4dd3-9e39-c796c38c4c90 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:24.036311 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fbaa498d-3060-4dd3-9e39-c796c38c4c90 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:24.037034 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-fbaa498d-3060-4dd3-9e39-c796c38c4c90 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:24.039911 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-955eea85-ed56-42a5-bf5a-fb0bed6bc9cd req-dee5275b-ac33-41a4-8fc4-1ceb386e07f1 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:24.040366 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-955eea85-ed56-42a5-bf5a-fb0bed6bc9cd req-dee5275b-ac33-41a4-8fc4-1ceb386e07f1 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:24.052875 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-955eea85-ed56-42a5-bf5a-fb0bed6bc9cd req-dee5275b-ac33-41a4-8fc4-1ceb386e07f1 service nova] Creating event network-changed:1188ffc3-d898-4abd-af14-4e2430064c04 for instance 5f3d8299-e098-4a1e-8875-9f5edf8281ba on hv-cinder-82786 Feb 08 16:58:24.058450 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-955eea85-ed56-42a5-bf5a-fb0bed6bc9cd req-dee5275b-ac33-41a4-8fc4-1ceb386e07f1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036704 Feb 08 16:58:24.059580 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 631/1266] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:58:24.084025 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-fbaa498d-3060-4dd3-9e39-c796c38c4c90 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Going to try to terminate instance {{(pid=122902) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 16:58:24.199260 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-fbaa498d-3060-4dd3-9e39-c796c38c4c90 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "DELETE /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 204 len: 0 microversion: 2.1 time: 0.180172 Feb 08 16:58:24.200404 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 636/1267] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Feb 8 16:58:24 2022] DELETE /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 16:58:24.212858 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-02c16bdc-f5c3-49af-ad3d-366bbd841afa tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:58:24.213729 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-02c16bdc-f5c3-49af-ad3d-366bbd841afa tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:58:24.224972 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-02c16bdc-f5c3-49af-ad3d-366bbd841afa tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:24.225354 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-02c16bdc-f5c3-49af-ad3d-366bbd841afa tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:24.226973 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-02c16bdc-f5c3-49af-ad3d-366bbd841afa tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:24.227641 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-02c16bdc-f5c3-49af-ad3d-366bbd841afa tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:24.574514 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-02c16bdc-f5c3-49af-ad3d-366bbd841afa tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:58:24.583664 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-02c16bdc-f5c3-49af-ad3d-366bbd841afa tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 200 len: 1578 microversion: 2.1 time: 0.376655 Feb 08 16:58:24.584604 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 632/1268] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:58:24 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 1578 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:58:25.605869 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-be142ed4-074a-4ac9-8d7e-66767f865d6e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:58:25.607091 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-be142ed4-074a-4ac9-8d7e-66767f865d6e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:58:25.622785 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b3e2031-2559-49c8-804b-d811ad0abe40] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 52468. Feb 08 16:58:25.624467 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-be142ed4-074a-4ac9-8d7e-66767f865d6e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:25.624967 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-be142ed4-074a-4ac9-8d7e-66767f865d6e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:25.625894 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-be142ed4-074a-4ac9-8d7e-66767f865d6e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:25.626391 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-be142ed4-074a-4ac9-8d7e-66767f865d6e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:25.855081 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-be142ed4-074a-4ac9-8d7e-66767f865d6e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:58:25.864099 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-be142ed4-074a-4ac9-8d7e-66767f865d6e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 200 len: 1460 microversion: 2.1 time: 0.264743 Feb 08 16:58:25.864851 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 637/1269] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:58:25 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 1460 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:58:26.585707 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO oslo.messaging._drivers.impl_rabbit [-] [20e13300-6106-4392-8fc7-3f3829534fee] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 52476. Feb 08 16:58:26.657460 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-22054ead-5856-43fa-97b3-0bd689d2e90c req-484767f6-b7be-4ddf-a2f2-53e68ba1c2ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3d8299-e098-4a1e-8875-9f5edf8281ba", "name": "network-vif-deleted", "tag": "1188ffc3-d898-4abd-af14-4e2430064c04"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:58:26.660167 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:58:26.660167 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:58:26.671961 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-22054ead-5856-43fa-97b3-0bd689d2e90c req-484767f6-b7be-4ddf-a2f2-53e68ba1c2ca service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:26.672613 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-22054ead-5856-43fa-97b3-0bd689d2e90c req-484767f6-b7be-4ddf-a2f2-53e68ba1c2ca service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:26.686954 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-22054ead-5856-43fa-97b3-0bd689d2e90c req-484767f6-b7be-4ddf-a2f2-53e68ba1c2ca service nova] Creating event network-vif-deleted:1188ffc3-d898-4abd-af14-4e2430064c04 for instance 5f3d8299-e098-4a1e-8875-9f5edf8281ba on hv-cinder-82786 Feb 08 16:58:26.694119 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-22054ead-5856-43fa-97b3-0bd689d2e90c req-484767f6-b7be-4ddf-a2f2-53e68ba1c2ca service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130279 Feb 08 16:58:26.695120 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 633/1270] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 08 16:58:26.887381 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-2b4b2047-c7cf-4431-9418-8caedac3cb07 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:58:26.888844 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-2b4b2047-c7cf-4431-9418-8caedac3cb07 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:58:26.897455 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2b4b2047-c7cf-4431-9418-8caedac3cb07 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:26.898017 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2b4b2047-c7cf-4431-9418-8caedac3cb07 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:26.898938 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2b4b2047-c7cf-4431-9418-8caedac3cb07 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:26.899452 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-2b4b2047-c7cf-4431-9418-8caedac3cb07 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:26.988224 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-2b4b2047-c7cf-4431-9418-8caedac3cb07 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:58:26.997669 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-2b4b2047-c7cf-4431-9418-8caedac3cb07 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 200 len: 1226 microversion: 2.1 time: 0.115103 Feb 08 16:58:26.998311 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 638/1271] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:58:26 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 1226 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 08 16:58:28.016233 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-324e6581-874e-4bc6-a96a-d1d8b0748415 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:58:28.017661 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-324e6581-874e-4bc6-a96a-d1d8b0748415 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 5f3d8299-e098-4a1e-8875-9f5edf8281ba] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:58:28.030207 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-324e6581-874e-4bc6-a96a-d1d8b0748415 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:28.030742 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-324e6581-874e-4bc6-a96a-d1d8b0748415 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:28.031612 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-324e6581-874e-4bc6-a96a-d1d8b0748415 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:28.032112 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-324e6581-874e-4bc6-a96a-d1d8b0748415 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:28.058585 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.wsgi [None req-324e6581-874e-4bc6-a96a-d1d8b0748415 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] HTTP exception thrown: Instance 5f3d8299-e098-4a1e-8875-9f5edf8281ba could not be found. Feb 08 16:58:28.059371 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-324e6581-874e-4bc6-a96a-d1d8b0748415 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Returning 404 to user: Instance 5f3d8299-e098-4a1e-8875-9f5edf8281ba could not be found. {{(pid=122901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:58:28.060561 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-324e6581-874e-4bc6-a96a-d1d8b0748415 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba" status: 404 len: 111 microversion: 2.1 time: 0.048959 Feb 08 16:58:28.061720 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 634/1272] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:58:28 2022] GET /compute/v2.1/servers/5f3d8299-e098-4a1e-8875-9f5edf8281ba => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 08 16:58:31.276106 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-6f8602ce-f0ea-4e22-ae0b-576b64f33e42 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:58:31.276988 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-6f8602ce-f0ea-4e22-ae0b-576b64f33e42 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 79af884c-4bb0-4d52-8b3a-7defe3227c9b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:58:31.279550 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-bdcfcbd3-d2d0-42f1-81ef-d450581b6287 req-321a0a5b-6a70-4912-b871-7065df839c80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79af884c-4bb0-4d52-8b3a-7defe3227c9b", "tag": "b53a3dcc-0b53-4ab1-9b7a-8662ca29e08a"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:58:31.282045 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:58:31.282045 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:58:31.285710 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6f8602ce-f0ea-4e22-ae0b-576b64f33e42 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:31.286262 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6f8602ce-f0ea-4e22-ae0b-576b64f33e42 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:31.287277 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6f8602ce-f0ea-4e22-ae0b-576b64f33e42 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:31.287965 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-6f8602ce-f0ea-4e22-ae0b-576b64f33e42 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:31.291036 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-bdcfcbd3-d2d0-42f1-81ef-d450581b6287 req-321a0a5b-6a70-4912-b871-7065df839c80 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:31.291489 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-bdcfcbd3-d2d0-42f1-81ef-d450581b6287 req-321a0a5b-6a70-4912-b871-7065df839c80 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:31.303217 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-bdcfcbd3-d2d0-42f1-81ef-d450581b6287 req-321a0a5b-6a70-4912-b871-7065df839c80 service nova] Creating event network-changed:b53a3dcc-0b53-4ab1-9b7a-8662ca29e08a for instance 79af884c-4bb0-4d52-8b3a-7defe3227c9b on hv-cinder-82786 Feb 08 16:58:31.310249 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-bdcfcbd3-d2d0-42f1-81ef-d450581b6287 req-321a0a5b-6a70-4912-b871-7065df839c80 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034213 Feb 08 16:58:31.314024 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 635/1273] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:58:31.323194 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-6f8602ce-f0ea-4e22-ae0b-576b64f33e42 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 79af884c-4bb0-4d52-8b3a-7defe3227c9b] Going to try to terminate instance {{(pid=122902) delete /opt/stack/nova/nova/compute/api.py:2615}} Feb 08 16:58:31.431513 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-6f8602ce-f0ea-4e22-ae0b-576b64f33e42 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "DELETE /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b" status: 204 len: 0 microversion: 2.1 time: 0.159524 Feb 08 16:58:31.435814 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 639/1274] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Feb 8 16:58:31 2022] DELETE /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 08 16:58:31.443518 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-afa4ae4c-c40a-4c09-9cfd-8e023bb07e09 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:58:31.444807 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-afa4ae4c-c40a-4c09-9cfd-8e023bb07e09 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 79af884c-4bb0-4d52-8b3a-7defe3227c9b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:58:31.452534 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-afa4ae4c-c40a-4c09-9cfd-8e023bb07e09 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:31.453498 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-afa4ae4c-c40a-4c09-9cfd-8e023bb07e09 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:31.455933 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-afa4ae4c-c40a-4c09-9cfd-8e023bb07e09 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:31.456652 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-afa4ae4c-c40a-4c09-9cfd-8e023bb07e09 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:31.722023 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.policy [None req-afa4ae4c-c40a-4c09-9cfd-8e023bb07e09 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122901) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:58:31.737492 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-afa4ae4c-c40a-4c09-9cfd-8e023bb07e09 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b" status: 200 len: 1577 microversion: 2.1 time: 0.299042 Feb 08 16:58:31.738777 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 636/1275] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:58:31 2022] GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b => generated 1577 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:58:32.761913 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-dfa30729-ec13-4fda-9cfe-a91e3a812b2e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:58:32.762666 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-dfa30729-ec13-4fda-9cfe-a91e3a812b2e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 79af884c-4bb0-4d52-8b3a-7defe3227c9b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:58:32.770318 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dfa30729-ec13-4fda-9cfe-a91e3a812b2e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:32.770775 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dfa30729-ec13-4fda-9cfe-a91e3a812b2e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:32.771580 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dfa30729-ec13-4fda-9cfe-a91e3a812b2e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:32.772060 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-dfa30729-ec13-4fda-9cfe-a91e3a812b2e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:32.921066 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-dfa30729-ec13-4fda-9cfe-a91e3a812b2e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:58:32.929291 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-dfa30729-ec13-4fda-9cfe-a91e3a812b2e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b" status: 200 len: 1459 microversion: 2.1 time: 0.173524 Feb 08 16:58:32.929865 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 640/1276] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:58:32 2022] GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b => generated 1459 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:58:33.531165 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [req-34fdde14-068e-4ffa-9550-19edf40bb313 req-e9860436-47bf-4817-8ec1-8a89cda23030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79af884c-4bb0-4d52-8b3a-7defe3227c9b", "name": "network-vif-deleted", "tag": "b53a3dcc-0b53-4ab1-9b7a-8662ca29e08a"}]} {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 08 16:58:33.534107 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 08 16:58:33.534107 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: warnings.warn(msg) Feb 08 16:58:33.543077 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-34fdde14-068e-4ffa-9550-19edf40bb313 req-e9860436-47bf-4817-8ec1-8a89cda23030 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:33.544112 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [req-34fdde14-068e-4ffa-9550-19edf40bb313 req-e9860436-47bf-4817-8ec1-8a89cda23030 service nova] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:33.557729 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.compute.server_external_events [req-34fdde14-068e-4ffa-9550-19edf40bb313 req-e9860436-47bf-4817-8ec1-8a89cda23030 service nova] Creating event network-vif-deleted:b53a3dcc-0b53-4ab1-9b7a-8662ca29e08a for instance 79af884c-4bb0-4d52-8b3a-7defe3227c9b on hv-cinder-82786 Feb 08 16:58:33.563989 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [req-34fdde14-068e-4ffa-9550-19edf40bb313 req-e9860436-47bf-4817-8ec1-8a89cda23030 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036185 Feb 08 16:58:33.564769 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 637/1277] 10.222.0.35 () {64 vars in 1317 bytes} [Tue Feb 8 16:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 08 16:58:33.948863 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-9172e40c-ceb9-4a03-bf66-a9c90987bb5e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:58:33.949655 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-9172e40c-ceb9-4a03-bf66-a9c90987bb5e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 79af884c-4bb0-4d52-8b3a-7defe3227c9b] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:58:33.957227 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9172e40c-ceb9-4a03-bf66-a9c90987bb5e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:33.957724 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9172e40c-ceb9-4a03-bf66-a9c90987bb5e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:33.958558 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9172e40c-ceb9-4a03-bf66-a9c90987bb5e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:33.958999 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9172e40c-ceb9-4a03-bf66-a9c90987bb5e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:34.001030 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9172e40c-ceb9-4a03-bf66-a9c90987bb5e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:34.001520 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-9172e40c-ceb9-4a03-bf66-a9c90987bb5e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:34.001975 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.objects.instance [None req-9172e40c-ceb9-4a03-bf66-a9c90987bb5e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lazy-loading 'fault' on Instance uuid 79af884c-4bb0-4d52-8b3a-7defe3227c9b {{(pid=122902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 08 16:58:34.047532 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.policy [None req-9172e40c-ceb9-4a03-bf66-a9c90987bb5e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd913a6397564f859fa9f1dd1edd4596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a449e431c5240b897d5cab55009fdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122902) authorize /opt/stack/nova/nova/policy.py:199}} Feb 08 16:58:34.056408 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-9172e40c-ceb9-4a03-bf66-a9c90987bb5e tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b" status: 200 len: 1230 microversion: 2.1 time: 0.111253 Feb 08 16:58:34.057054 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 641/1278] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:58:33 2022] GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b => generated 1230 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 08 16:58:35.074994 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-36208ea9-0cc2-42a4-b83e-cf3a0251eca5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:58:35.075702 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-36208ea9-0cc2-42a4-b83e-cf3a0251eca5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 79af884c-4bb0-4d52-8b3a-7defe3227c9b] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:58:35.083221 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-36208ea9-0cc2-42a4-b83e-cf3a0251eca5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:35.083729 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-36208ea9-0cc2-42a4-b83e-cf3a0251eca5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:35.084551 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-36208ea9-0cc2-42a4-b83e-cf3a0251eca5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:35.084996 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-36208ea9-0cc2-42a4-b83e-cf3a0251eca5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:35.101120 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.wsgi [None req-36208ea9-0cc2-42a4-b83e-cf3a0251eca5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] HTTP exception thrown: Instance 79af884c-4bb0-4d52-8b3a-7defe3227c9b could not be found. Feb 08 16:58:35.101715 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-36208ea9-0cc2-42a4-b83e-cf3a0251eca5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Returning 404 to user: Instance 79af884c-4bb0-4d52-8b3a-7defe3227c9b could not be found. {{(pid=122901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:58:35.102690 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-36208ea9-0cc2-42a4-b83e-cf3a0251eca5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b" status: 404 len: 111 microversion: 2.1 time: 0.032221 Feb 08 16:58:35.103244 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 638/1279] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:58:35 2022] GET /compute/v2.1/servers/79af884c-4bb0-4d52-8b3a-7defe3227c9b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:58:35.891150 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-51b0e085-5043-454d-b593-06c6009412b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:58:35.892337 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.compute.api [None req-51b0e085-5043-454d-b593-06c6009412b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122902) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:58:35.898421 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-51b0e085-5043-454d-b593-06c6009412b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:35.898884 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-51b0e085-5043-454d-b593-06c6009412b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:35.899690 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-51b0e085-5043-454d-b593-06c6009412b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:35.900159 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG oslo_concurrency.lockutils [None req-51b0e085-5043-454d-b593-06c6009412b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:35.915839 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.wsgi [None req-51b0e085-5043-454d-b593-06c6009412b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] HTTP exception thrown: Instance 37885d5b-9597-417c-9d29-bd637383943d could not be found. Feb 08 16:58:35.916432 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-51b0e085-5043-454d-b593-06c6009412b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Returning 404 to user: Instance 37885d5b-9597-417c-9d29-bd637383943d could not be found. {{(pid=122902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:58:35.917278 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-51b0e085-5043-454d-b593-06c6009412b5 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "DELETE /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 404 len: 111 microversion: 2.1 time: 0.030790 Feb 08 16:58:35.917829 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 642/1280] 10.222.0.35 () {58 vars in 1238 bytes} [Tue Feb 8 16:58:35 2022] DELETE /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 08 16:58:35.926345 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-15ae8005-bd1e-480d-9302-3bc1ee01bd35 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '>' {{(pid=122901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:58:35.927005 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.compute.api [None req-15ae8005-bd1e-480d-9302-3bc1ee01bd35 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] [instance: 37885d5b-9597-417c-9d29-bd637383943d] Fetching instance by UUID {{(pid=122901) get /opt/stack/nova/nova/compute/api.py:2866}} Feb 08 16:58:35.933569 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-15ae8005-bd1e-480d-9302-3bc1ee01bd35 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:35.934109 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-15ae8005-bd1e-480d-9302-3bc1ee01bd35 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:35.934903 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-15ae8005-bd1e-480d-9302-3bc1ee01bd35 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 16:58:35.935331 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG oslo_concurrency.lockutils [None req-15ae8005-bd1e-480d-9302-3bc1ee01bd35 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Lock "d3f377b9-f250-471d-9570-5d0606368cf5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 16:58:35.948912 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.wsgi [None req-15ae8005-bd1e-480d-9302-3bc1ee01bd35 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] HTTP exception thrown: Instance 37885d5b-9597-417c-9d29-bd637383943d could not be found. Feb 08 16:58:35.949498 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: DEBUG nova.api.openstack.wsgi [None req-15ae8005-bd1e-480d-9302-3bc1ee01bd35 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Returning 404 to user: Instance 37885d5b-9597-417c-9d29-bd637383943d could not be found. {{(pid=122901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 08 16:58:35.950309 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO nova.api.openstack.requestlog [None req-15ae8005-bd1e-480d-9302-3bc1ee01bd35 tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d" status: 404 len: 111 microversion: 2.1 time: 0.028070 Feb 08 16:58:35.950842 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: [pid: 122901|app: 0|req: 639/1281] 10.222.0.35 () {58 vars in 1235 bytes} [Tue Feb 8 16:58:35 2022] GET /compute/v2.1/servers/37885d5b-9597-417c-9d29-bd637383943d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 08 16:58:37.272748 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: DEBUG nova.api.openstack.wsgi [None req-bd003766-6dc4-4010-92ff-24ef9f5b741b tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] Calling method '.version_select at 0x7fcde0cd0a60>' {{(pid=122902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 08 16:58:37.297453 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO nova.api.openstack.requestlog [None req-bd003766-6dc4-4010-92ff-24ef9f5b741b tempest-TestVolumeBootPattern-246396939 tempest-TestVolumeBootPattern-246396939-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1759950308" status: 202 len: 0 microversion: 2.1 time: 0.029557 Feb 08 16:58:37.298145 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: [pid: 122902|app: 0|req: 643/1282] 10.222.0.35 () {58 vars in 1262 bytes} [Tue Feb 8 16:58:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1759950308 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 08 16:59:57.573775 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 16:59:57.574381 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: Tue Feb 8 16:59:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 17:01:42.364153 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:01:42.364999 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: Tue Feb 8 17:01:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 17:01:43.619433 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:01:43.620253 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: Tue Feb 8 17:01:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 17:03:17.582331 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:03:17.583042 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: Tue Feb 8 17:03:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 17:03:44.406931 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:03:44.407940 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: Tue Feb 8 17:03:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 17:03:47.652224 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:03:47.652899 dv-cinder-827860-2-iscsi devstack@n-api.service[122901]: Tue Feb 8 17:03:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 08 17:04:09.415954 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 08 17:04:09.416602 dv-cinder-827860-2-iscsi devstack@n-api.service[122902]: Tue Feb 8 17:04:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!